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EMPLOYMENT PSYCHOLOGY IN THE RUBBER 
INDUSTRY 



By Harold E. Burtt, Ohio State University 



1, Introduction 
The writer spent several months in the spring of 1919 as 
Consulting Psychologist of a large Canadian rubber company. 
Most of the time was devoted to the development of tests 
for the use of the employment office of a rubber tire factory. 
It was not originally intended to publish an account of this 
work, because it involved no radically new kinds of tests, 
because there were no inter-correlations of theoretical interest 
and because if detailed test procedure was published it might 
be used by the incompetent or might even reach the hands of 
prospective employees. However, after reading Link's recent 
book on Employment Psychology, it seemed worth while to 
give a general account of the methods used at the tire factory, 
as they illustrate the solution of problems similar to those 
recounted by Link, but with a quite different statistical ap- 
proach. In both instances the general principle was to cor- 
relate test scores with known vocational ability, but in one 
case a wide range of factory and clerical operations was cov- 
ered with rather simple statistical treatment and in the present 
instance fewer operations were studied, but with the use of 
partial correlations. Furthermore the personal experiences 
of the writer in methods of organizing the work, enlisting 
the co-operation of executives, and arranging for the continu- 
ance of the work might be of interest. In the near future 
when this field is quite apt to be exploited by those with too 
little ability and too much enthusiasm, there will be a need 
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2 BURTT 

for a restraining influence in the form of conservative ac- 
counts of personnel work done with strictly scientific pro- 
cedure. It is hoped that the following will be a slight con- 
tribution of this sort. 

2. Preliminary Work 

The preliminary work at the factory fell into two parts, — 
getting personally oriented and getting in the proper rapport 
with those in authority. It was necessary at the outset to 
become familiar with the different types of work carried on 
at the factory and to learn the technical terminology. This 
knowledge was necessary for later analysis of the mental fac- 
tors involved in various factory operations. One of the 
assistants to the Factory Superintendent was detailed as aide 
to the writer, — conducting him about the factory, explaining 
the work and introducing him to various foremen so that it 
was possible to get acquainted and talk over the mental and 
physical qualifications for various kinds of work. A further 
study was made of the methods of accounting, time study and 
evaluating piece-work. These facts were of value in getting 
production ratings of men who were tested, and following up 
new workers. Data were secured on labor turnover to see 
what departments apparently needed the most attention. It 
was necessary, also, to become familiar with the executive 
organization in order to know to whom to go for information 
or to get various things done. 

The second preliminary step was to get in the proper rapport 
with the personnel whose co-operation would be needed in 
the work. The factory at the time was managed by an operat- 
ing council of five men, rather than a single manager. An 
early meeting with this council was arranged in order to dis- 
cuss plans. These men readily saw the purpose and the gen- 
eral methods of the work. Shortly after this a meeting of all 
the foremen was called. They had an organization of their 
own and this meeting was scheduled as one of their regular 
meetings with the writer as an outside speaker. A talk was 
given about personnel work in the army leading up to the 
question of round pegs in square holes in industry. The mat- 
ter was finally brought home to them and the proposed work 
explained in detail and their co-operation enlisted. Practically 
all of them were much interested in the matter and this pre- 
liminary discussion was all that was ever necessary in obtain- 
ing^ their cu-operation in the work. This rapport was also 
furthered by the writer's frequent presence in the factory. He 
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PSYCHOLOGY IN THE RUBBER INDUSTRY 3 

visited different departments very often, talked with the fore- 
men, watched the workmen and made himself felt generally 
as a part of the organization. Shortly after the foremen's 
meeting a preliminary series of tests covering a rather wide 
range of mental factors was given to the executives, to most 
of the foremen, and to a sampling of the factory workers. 
This served the purpose of familiarizing them with the nature 
of mental tests. This was especially desirable because from 
information that reached the writer indirectly it was found 
that the conception of mental tests held by the majority of 
the factory personnel varied from phrenology to microscopic 
x-ray examination of the brain. The results of this prelim- 
inary series were of some statistical import, but their greatest 
function lay in familiarizing those whose co-operation was 
especially needed with the methods. 

3. Obtaining the Criterion 

As early as possible in the research (as soon as the foremen 
had been tested) vocational ratings of a large number of 
workers in the factory were obtained. The writer learned a 
bitter lesson in the Air Service in testing large numbers of 
men and being unable to get subsequent vocational ratings. 
It was highly advantageous to have the criterion before any 
tests were given at all. This made it possible to send to the 
factory the names of men whom it was desired to test. Thus 
when only a sampling of those engaged in a given type of work 
was to be tested, it was feasible to get a sampling correspond- 
ing roughly to a normal distribution curve for ability in that 
work. Otherwise the sampling might comprise those at one 
extreme of ability or only those in the middle range with 
resulting lower correlations due to the homogeneity of the 
group. Furthermore if some of the men desired were un- 
available (e. g., were on the night shift) it was possible to 
substitute others of similar vocational ability. 

Two measures of vocational ability were desired in order 
to correlate with two scores in each test, and correct the co- 
efficient for attenuation. In several operations three ratings 
besides the production ratings (piece-work) were available ; the 
inspector who had perhaps a dozen men under him furnished 
one rating, the foreman who had charge of finishing or build- 
ing or cord building, etc., furnished a second, and the head 
foreman of the whole floor a. third. One of these could then 
be combined with the production rating and the other two 
averaged. 
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4 BURTT 

The rating sheet used was similar to that described by 
Miner.^ Five adjacent columns each ten millimeters in width 
were headed " high test 5th," " middle 5th," etc The names 
of the workmen were t3rped in a column at the left and the 
foremen requested to place after each man's name a cross in 
the appropriate column. The foremen were further encour- 
aged to grade a man's ability as finely as possible by placing 
the cross to the right or to the left of the column. These 
ratings were measured in millimeters from the edge of the 
chart and furnished a score between and 100. Inasmuch as 
the ratings by diflFerent foremen and inspectors varied con- 
siderably, — some rating all their men higher than did others, — 
each foreman's ratings were averaged, the standard deviation 
computed and the original measures converted into ratios of 
individual deviation to standard deviation for that foreman. 
The production ratings were treated in the same manner. It 
was then valid to average one foreman's rating with the piece- 
work score and to average together the other two foremen's 
ratings. These two figures could then be correlated with the 
two test measures (infra). This method was used in all cor- 
relations where the coefficient was corrected for attenuation. 
In some factory operations which were not to any considerable 
extent specialized or in which only a small number of workers 
were engaged, the foremen were asked merely to select a few 
of the best and a few of the worst workmen. The desirability 
of correcting the coefficient of correlation whenever possible 
was shown by the low correlations sometimes found between 
the ratings of the same workmen by different foremen. These 
coefficients were sometimes as low as .60 whereas correlations 
between two parts of the same test were generally in the 
vicinity of .90. 

4. Selection of Tests 

There are two current tendencies in developing methods of 
vocational selection. The first strives to reproduce in minia- 
ture the work or the mental situation involved. This method 
might be illustrated by Dodge's tests for Gun-pointers in the 
Navy. The second attempts to analyze the mental abilities 
involved in the work, and test these separately. This method 
might be t)rpified by the Air Service tests of aptitude for 
flying. In both cases the procedure is, of course, empirical, — 
evaluating the methods upon persons of known ability before 
applying them to unknown applicants. 

ij. B. Miner. ''Evaluation of a Method for Finely Graded Esti- 
mates of Abilities." Journal of Applied Psychology, 1917, 1, 123-133. 
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# 

The latter of these two methods was used in the present 
instance. The specialized forms of work in a tire factory 
involved so many minor operations as to necessitate very com- 
plex apparatus. Several involved the handling of new rubber 
stock, whidi is sticky, — b, condition difficult to reproduce in 
standardized form in the laboratory. Consequently various 
forms of work were analyzed into their mental and motor 
components, and a limited number of tests measuring these 
components were applied to workers of a given sort 

The majority of the tests were given by means of mimeo- 
graphed blanks to a group of people simultaneously. Others 
involved individual examination and a certain amount of ap- 
paratus. Thirty-two tests were used in all covering a rather 
wide range. It is difficult and unnecessair to say what mental 
factor a test specifically measures, but there were in the list 
of tests selected some in which the emphasis lay upon motor 
processes, reaction time, attention, observation, learning, asso- 
ciation, memoty, reasoning, space and time perception, social 
insight, ingenuity and ability to follow directions. 

The tests given on blanks were adaptations of recently 
devised methods drawn from various sources, such as the 
material left by the late Professor Munsterbei^, the work of 
the Carnegie Institute of Technology, various test blanks used 
in the Air Service and the Sanitary Corps in the army, and 
scattered periodical accounts. In most cases the material 
was worked over considerably. Anything distinctly academic 
in categories, terminology or range of information was sim- 
plified to come within the range of the average workman. 
Geographical factors were likewise adapted to local condi- 
tions and all extraneous matters eliminated as far as possible. 
Each test was given on a separate sheet with a brief example 
at the top. Standardized instructions involving the explana- 
tion of the example were used. Tests in this form were 
suitable for group examination. They were all performed 
with a time limit. They were tried first of all upon a few 
people in order to determine a proper time interval which 
would not be unnecessarily long but would still give consid- 
erable scatter in amount done by different persons and in 
order to include enough material so that no one would finish 
the test within the allotted time. The usual precautions were 
taken as to seating, lighting, sharpening of pencils and start- 
ing and stopping at signal. 

The individual tests were mostly adaptations of the con- 
ventional motor tests, described in the manuals such as Whip- 
ple's. Various types of reaction time were also measured 
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with a chronoscope. A few tests devised by the psychology 
sub-committee on Aviation of the National Research Council 
were included. A few people were given these tests as a 
preliminary step to determine the number of trials or the rate 
of performance (if done at a controlled speed). The amount 
of practice and the instruction for each performance were 
standardized. 

All the tests except those in the preliminary series described 
below, in which no careful correlations were to be obtained, 
were given in two installments. Ideally these should occur 
on separate days, but it was fairly satisfactory to go through 
the first installments of each test given to a particular person 
or group of persons in turn and then go through the second 
installments in the same order. Each installment was divided 
in two equal parts on the basis of time. This was facilitated 
in group examination by having the persons make a check 
mark at the point where they were working at the given signal. 
With these four test measures the first one of the first install- 
ment was averaged with the last one of the last installment 
and tjie other two likewise averaged together. This gave two 
test measures which could be correlated with the two vocational 
measures described above to correct the coefficient of correla- 
tion for attenuation. 

5. The Laboratory 

All the testing in the research stages of the work was done 
by the writer. A large well lighted room in the office build- 
ing was equipped for a laboratory, containing the apparatus 
for the individual tests and table facilities for testing several 
people simultaneously on group tests. For larger groups (ten 
or twelve) a large private office with extra tables was used. 

It is sometimes suggested that a laboratory of this sort 
should be in the factory itself, in order to obtain the work- 
men at the right time, to afford no sharp contrast with shop 
conditions and consequent nervousness, and to keep the ex- 
perimenter in touch with the shop work. In the present 
instance the use of the laboratory was perfectly satisfactory. 
A list was sent the day before to the man in charge of time 
cards at the factory of the men whom it was desired to test 
on the morrow, together with the hour at which they were 
wanted and the approximate length of time they would be 
needed. There appeared to be no great shock on the part of 
the workmen in coming from the factory to the more quiet 
laboratory, for the news of the work and the nature of the 
tests spread rapidly through the personnel. Furthermore the 



Digitized by 



Google 



PSYCHOLOGY IN THE RUBBER INDUSTRY 7 

writer found ample contact with factory conditions in inter- 
viewing foremen and watching various men at work. 

6. Preliminary Series 

The first actual testing done at the factory consisted of a 
set of twenty. group tests covering a fairly wide range of 
mental factors and occupying about two hours. The purposes 
of this series were three: first, — as indicated above, to 
familiarize those in authority, especially the optTzting council 
and foremen with the methods so that they would be in a 
better position to co-operate in getting workmen to take the 
tests and in providing ratings ; secondly, — ^to determine which 
types of tests were most promising for further study in con- 
nection with special factoiy operations; thirdly, — ^to obtain 
a rough notion of the distribution of intelligence throughout 
the factory. 

The tests were given to the operating council, other execu- 
tives in the factory, some of the clerical force and laboratory 
personnel and a sampling of workers in a considerable number 
of factory operations, including equal numbers of good and 
poor workers of each sort. After the foremen had been tested 
there was a pause while getting ratings of the workmen in 
order to select the aforementioned samplings. 

Each test was averaged for each occupational group and 
also for the entire number of people tested. The group 
averages, and in some cases individual scores, were all tabu- 
lated as a ratio of the score in a test to the grand average for 
that test. It was found that occupational group averages in 
some tests showed a much greater difference between extremes 
than in other tests. For example, the extremes of one test 
ranged from 81 to 112 per cent, whereas in another test they 
ranged from 5 to 184 per cent. The first of these would 
obviously be of little value in differentiating groups of workers 
of the sort studied. Furthermore certain groups were mark- 
edly superior 6r inferior in certain tests. These facts together 
with a detailed individual study of good versus poor workers 
in various groups, gave the starting point for subsequent work, 
indicating, for example, whether motor, attentive or memory 
processes were most involved in a given factory operation. 

All twenty tests were averaged together for each occupa- 
tional group. This average of the twenty tests, inasmuch as 
they covered a fairly wide range, gave a rough index of general 
intelligence. Presumably any combined score of a consid- 
erable range of tests gives such an index and it is merely then 
a question of determining norms. This is what is done, of 
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course, in various point-scales for intelligence. Comparing the 
different groups of workers in intelligence there was found 
an occupational hierarchy. The operating council, laboratory 
force and clerical workers stood rather high in intelligence. 
The shipping clerks and general factory executives were appre- 
ciably lower. Still lower came the foremen and fairly skUled 
workers, such as finishers and builders. Below these were the 
less specialized forms of factory workers and at the bottom 
of the scale the unskilled laborers. This occupational hierarchy 
is interesting in its agreement with the similar one found in 
the army on the basis of the Alpha examination.^ It wotdd 
seem that there are different kinds of industrial performance, 
each with its minimum intelligence requirements and that a 
person tends finally to reach the highest level for which his 
intelligence qualifies him. 

7. Statistical Methods 

In subsequent series test scores were correlated with known 
vocational ability, in order to select the best tests and weight 
them properly to obtain the best possible vocational prediction. 

As soon as the ratings and the test scores were in final 
form, the correlation formula involving rank differences 
squared was used for a preliminary selection of the tests. The 
best ones were then correlated by the " products-moments " 
formula. There were two scores in each test and two meas- 
ures of vocational ability as above described. The necessary 
correlations of these were computed to be used in the fol- 
lowing formula: 

V^.T..V.T..V.T..V.T. 

V/V.V..T.T. 

where Vj and V, are the two vocational ratings (cf. section 

3 supra) and T^ and T, are the two test measures, (section 

4 supra) and Vj Tj indicates the correlation between Vj and 
Ti, etc. To correct the coefficients for the inter-test correla- 
tions, the simpler formula was used: 

\/AiB>.A3i 
\/AiA,.BiB, 

in which A^ is the first measure in the test A, A^ the second 
measure in test A and similarly for B^ and B, and A^B^ indi- 

> The only published account of this study is an abstract of a paper 
read at the 1918 meeting of the American Psychological Association by 
J. W. Bridges, Psychological BulUtm, 16, 1919, p. 42. 
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cates the correlation between these two measures. This latter 
formula seemed justifiable for inter-test correlations because 
the two parts of each test correlate highly, whereas foremen's 
ratings do not inter-correlate as highly, and consequently more 
careful correction is necessary. 

The coefficients of partial correlation were then obtained 
for the given factory operation and the r^^ession equation 
computed. The writer usually follows the method outlined 
by Rosenow.* The practical problem is to select as few tests 
as possible while still giving a high prediction. Five tests 
may give, for example, practically as good a prediction as 
seven tests with a consequent saving of time. Rosenow's 
method was followed of computing from a limited number of 
partial coefficients the final R of multiple correlation, i. e., 
the correlation of combined weighted test scores with the 
criterion. It is convenient in numbering the variables to take 
as the end ones, those most apt to be dropped, — for example 
with a criterion X^ and 6 tests, X^ to X^, it is wise to select 
as X, and X^ the tests which have lowest correlation with 
the criterion. Thus when the R of multiple correlation for 
all six tests has been found, without additional labor one can 
determine the R that will be obtained by dropping test two 
or test seven. 

The regression equation was then worked out for the vari- 
ables which were retained. A table for weighting the test 
scores was made, the original test measures weighted accord- 
ingly and the combined score correlated with the criterion as 
a check on the whole procedure. The individual combined 
weighted scores were now averaged and their standard devia- 
tion computed in order to make from the probability integral 
a decile distribution. A ten by ten fold table was then con- 
structed from the probabiUty integral for the given R of 
multiple correlation showing what per cent of those in the 
highest tenth in one variable were in the highest, second, third, 
etc., tenth in the other variable. Substituting for the deciles 
in one variable the deciles of combined weighted test scores 
and letting the other variable represent vocational ability, 
it was possible from the table to predict the probability of a 
person attaining a given score in the test of falling within 
any decile of vocational ability. 

8. Tests for Special Factory Operations 
It was necessary, of course, to limit the number of tests 

•Roscnow, C. The Analysis of Mental Functions, Psychological 
Review Monographs, No. 106, 1917 (appendix). 
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given to special operatives to those forms which had greatest 
promise. This limiting was done in two ways. In the first 
place the operations were analyzed as far as possible by 
observing men at work and talking with foremen as to the 
mental qualifications needed for the given operation. Sec- 
ondly the preliminary series (supra) in which a few good and 
poor workers of various sorts took a wide range of tests, made 
it possible to limit the number of tests to the general cate- 
gories which appeared of significance in this preliminary study. 

The first operation studied intensively was that of finishing 
tires. There was a large labor turnover in this department 
and it apparently involved rather specialized ability. The 
worker received the tire partially built on the iron core, put 
stock of lighter weight on the outside and rolled it down, 
spinning the tire by hand. He was furnished with strips of 
stock of varying widths which had to be applied to certain 
parts of the tire, in some cases following a line rather closely. 
This operation was grouped with that of treading tires because 
the two were quite similar, except that in treading, no stock 
was applied near the rim. Thirteen tests were given to fin- 
ishers of known ability, — tests involving motor ability, learn- 
ing, attention, reaction time and judgment of distance and 
velocity. One surprising result was the low correlation of 
vocational ability with most of the tests involving motor co- 
ordination such as the conventional forms of tapping, aiming 
and steadiness tests. Six of the tests correlated rather highly 
with ability at the work, but it was found that three tests 
properly weighted gave practically as good a prediction. These 
tests involved underlining adjacent pairs of numbers whose 
sum was ten in a large group of numbers, finding consecutive 
numbers scattered at random over a page, and simple visual 
reaction. These tests properly weighted gave a correlation 
with finishing ability of .61. 

The second group of operatives studied were those who 
handed out stock. The operation was fairly simple involving 
looking at the numbers on tags at the finishing benches, re- 
membering the specifications long enough to go to the place 
where the stock was " booked " (placed between sheets of 
cloth to avoid sticking), and supplying the stock to the finisher. 
This was not a difficult operation, but had a considerable turn- 
over. Ten tests were given involving memory, reasoning, 
directions, association, learning and attention. The regn'^sion 
equation for eight variables (that is seven tests) gave a corre- 
lation with ability at this work of .71. Using only three of 
these tests, a correlation of .67 could be obtained. These three 
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tests involved underlining adjacent numbers whose sum was 
ten, underlining adjacent letters which formed words in an 
unseparated mixture of letters and memory tested by the 
method of word pairs. 

The operation of tire building was somewhat like finishing. 
The iron core was placed on the machine, the stock from the 
rollers above pulled down and placed on the core, the clutch 
thrown with the foot to spin the tire and then the rollers 
applied by turning a small lever. Several plys were placed on 
each tire as well as a bead near the rim. Thirteen tests similar 
to those used with finishers were given to builders of known 
ability. The results were negative, — no correlation being 
greater than .16. There were three possible explanations : (1 ) 
None of the mental factors tested were involved in the build- 
ing operation; (2) the vocational ratings were unreliable; (3) 
the men did not work with maximum effort at the tests. As 
to the first possibility it is doubtful, in view of the range of 
tests tried, that none of the factors involved in building were 
represented. As to the second point the correlation coefficients 
were corrected for attenuation, which should theoretically com- 
pensate, to a considerable extent, chance errors in the voca- 
tional estimates. The third explanation seemed the most prob- 
able. The average worker did not feel that his present job 
was permanent, but was considering possibilities of advance- 
ment or discharge. The average or good builder, however, 
received good pay and felt that his position was permanent 
and was consequently less interested in the tests (witness the 
fact that a number of builders refused to take the tests, whereas 
this seldom occurred with other operatives). The poor build- 
ers, however, might realize their ability and try hard in the 
tests. There were obvious cases where a builder appeared 
rather indifferent to the work. It was planned to check this 
factor later by testing new help who were hired for building. 
In the emplo)rment office they would doubtless work with 
maximum incentive. 

The clerical workers were made the basis of a brief study. 
No effort was made to differentiate various kinds of office 
work, but the employees were rated merely for general clerical 
ability aside from stenography. Ratings were made by various 
managers and heads of departments. Ten tests involving 
attention, memory, association, and so-called alertness were 
used. Four of these tests were retained in the regression 
equation, — ^underlining adjacent letters which formed a word, 
reading a text in which alternate letters were to be omitted 
in order to make sense, an arithmetical test, and an analogies 
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test in the form given in the army Alpha. This combined test 
score correlated with clerical ability to the extent of .56. 

It was necessary to group together all the remaining gen- 
eral factory operations. In all the other forms of work there 
were either too few people engaged in the same sort of work 
to make a valid basis for statistics, or the work itself was 
quite simple and obviously did not need a specialized mental 
make-up. The problem then was to devise a simple group of 
tests to differentiate good workers in moderately sldlled opera- 
tions in general from poor workers, and to further differen- 
tiate this class from unskilled laborers. A sampling of good 
and poor workers was taken from various parts of the factory 
including final inspection, bicycle tires, bead wrapping, wire 
department, sundries, stodc rolling and booking, solid tire, etc. 
A few of the best and worst workers of each sort were selected 
by the foremen. They were given nine different tests. With 
the ratings merely in two groups, detailed statistical treatment 
was impossible so the method of unlike signed pairs was 
used. Five tests were retained, inter-correlated and weighted 
by inspection. These tests were mostly of the sort generally 
characterized as intelligence tests such as memory for word 
pairs, association of opposites, absurdities, substitution and 
the like. There was a fairly close correspondence between 
combined test score and general ability in the factory. As 
nearly as could be estimated this correlation was about .5(X 

9. Testing New Employees 

Most of the men passing through the employment office dur- 
ing about a month, with the exception of those who were 
obviously fitted for only unskilled labor, were tested. The 
ten by ten fold table described above was too complicated for 
use in the emplo)mient office, so a simplified form like the 
following was devised: 

"Work; Tire Finishing 

By good workers is meant the best three tenths of a large 
number of workers taken at random. 

By average workers is meant the next three tenths, i. e., the 
Mh, 5th and 6th. 

By poor workers is meant the next three tenths, i. e., the 
7th, 8th and 9th. 

By very poor workers is meant the lowest tenth. 

Of a hundred men scoring in tests: 

128 or better: 73 will be good, 21 average, 6 poor, very 
poor. 
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103 to 127: 56 will be good, 31 average, 12 poor, 1 very 
poor, etc. 

These figures instead of showing how many out of a hun- 
dred people obtaining a given score will be good, average, etc., 
may be used equally well to predict a probability of a single 
applicant; for example, if a man scores 128 or better, the 
chances are 73 out of 100 that he will be a good worker, 21 
out of a 100 that he will be an average worker, etc." 

It was desirable both in this blank and in personal con- 
versation to emphasize the probability aspect of the predic- 
tion in order to minimize the effect of the occasional cases 
apparently violating the general rule. Business people are 
very apt to attach great weight to a single case in which a 
person who does well in the tests does poorly in the factory, 
neglecting the fact that there is always a certain probability 
of such a thing happening. 

These tables for the various correlation coefficients or for 
the various factory operations were placed in the hands of 
the employment manager. Most of the recommendations at 
this time were made in person by the writer with these blanks 
before the manager. In a larger establishment where there 
were various parties concerned with hiring employees and 
where more occupations had been studied, it would doubtless be 
advisable to have a blank form printed for each factory opera- 
tion, enter the individual's name on this blank, and place a 
check mark in the class into which he fell in his test scores, 
thus indicating at a glance his probable success in that work. 

In the present instance effort was made to hire men who 
fell only in the best five or six tenths in test scores. The 
per cent of rejections would depend, of course, upon the labor 
market. During the war, for instance, industries were com- 
. pelled to hire practically anyone who was available regardless 
or^bility or probable success. Supposing, for example, the 
lowest ten per cent of workers of a given sort constituted the 
labor turnover, if men were hired at random for this work 
the turnover would be ten per cent If test score and voca- 
tional ability correlated to the extent of .70 and enough appli- 
cants were available so that only the best half could be 
selected, the decile tables above described show that this labor 
turnover could be reduced to one per cent. With a coefficient 
of .60, the ten per cent turnover could be reduced to about 
two per cent. If the two lowest deciles represented labor 
turnover, with a coefficient of .70, this twenty per cent turn- 
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over could be reduced to about four per cent. Any other 
expectation on the basis of a given coefficient for a given 
percentage which constituted a turnover could be worked out 
from the tables. 

The test program in the case of given workers depended 
largely upon the positions vacant in the factory. At the time 
most of the new help were tested by the writer, there was a 
considerable need for tire finishers. Consequently all appli- 
cants who appeared at all promising were given the tests 
described above for finishers. If a number presented them- 
selves at once they were given together two of the tests and 
then each individual was taken separately through a measure- 
ment of visual reaction time. A stenographer provided with 
stencils for correcting the tests and tables for weighting them 
was a,ble generally to keep up with this procedure, so that a 
few minutes after the last man had been through the reaction 
time test, vocational predictions were available for the entire 
group. Those who fell in the upper five or six tenths in the 
finishing score were immediately recommended for that work. 
Those who fell below this standard were given tests for 
handing out stock, if workers of that sort were needed at 
the time, otherwise they were given the test for general factory 
work. If they did well in this latter they were recommended 
for any general moderately skilled operation where there was 
need, but if they did poorly in this series, they were recom- 
mended for some unskilled laboring operation. If there was 
a need for clerical help, some of those who appeared more 
alert were given the clerical tests. This whole procedure would 
doubtless be different at a time when workers for some other 
operations besides finishing were badly needed. The general 
system with a large number of regression equations available 
would be to give first the tests for those occupations where 
there was the greatest need. 

It occasionally happened that the recommendations on the 
basis of the tests ran counter to an individual's interest. A 
man naturally succeeds better at something in which he is 
interested. If, however, he preferred a certain type of work 
for which he was mentally or physically unfit, it was an eco- 
nomic loss both to himself and to the company to engage him 
for that work. When such a situation was found, effort was 
made to dissuade the man from the work which he wished to 
do. Failure in the work would doubtless cause a loss of 
interest, and the plodder who learns after a long time with 
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economic loss to himself and to the company, is an exception. 
In many cases where the man appeared rather intelligent, the 
method of developing the tests and his probable expectation 
on the basis of his results were explained to him, so that he 
tmderstood that his recommendation for some other occupation 
was due to the fact that he stood a poor chance of success in 
the one he preferred. 

As the writer did not intend to remain with the factory 
permanently, a man was trained to carry on the work of testing 
applicants in the employment office. He first spent some 
time watching the writer give the tests and studied the in- 
structions carefully. He then gave the tests himself under 
the supervision of the writer and all undesirable reactions 
were corrected. He was provided with a manual and tables 
for weighting the tests so that it was possible for him to 
obtain the weighted test scores with perfectly standardized 
method. 

Effort was made during this month to follow up the men 
hired on the basis of test scores. Few of the men reached 
the piece-work stage during this period, but record was ob- 
tained of their daily production and in many cases estimates 
obtained from foremen as to their probable success. Had 
the writer remained on the ground longer, these estimates, 
of course, would have been much more systematized. Prac- 
tically all the men who scored above the average in the tests 
and were hired on that basis were doing successful work when 
the writer left. A number of men with low test scores were 
hired as a check on the method. All of these gave up the work 
in the course of a short time, indicating that lack of success 
seemed to produce lack of interest. 

The work was running smoothly when the writer left. Shortly 
after that time, there was a change in the executive personnel 
of the company, — the president and general technical super- 
intendent, who had been the main sponsors of this work, being 
among those who resigned. At the present writing the work 
has been temporarily dropped, but it is hoped that it will later 
be resumed because at last accounts it was definitely vindi- 
cating itself. 

10. Conclusions 

The foregoing account of research at a rubber tire factory 
illustrates one method of psychological approach to the prob- 
lems of vocational selection in industry. The general pro- 
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cedure was the standardization of mental and motor tests upon 
workmen of known vocational ability in order to use these 
standards in assigning applicants at the employment office to 
the type of work in which they stood the greatest chances of 
success. The operations at the factory seemed to fall into 
three large classes: those requiring no special mental ability, 
such as shoveling and trucking; those involving the learning 
of a few relatively simple operations and requiring a modicum 
of general intelligence; and those involving more definitely 
specialized mental or motor abilities. The last of these pre- 
sented by far the largest and most difficult problem. 

Effort was made in all cases to obtain the. criterion, i. e., 
the vocational or production rating before tests were given 
at all. Ratings made by a given foreman were transformed 
into terms of the standard deviation of his ratings. They 
could then validly be averaged with estimates made by another 
foreman. A wide range of tests, both group and individual, 
were used. Certain of these were selected for each operation 
studied on the basis of tests of a preliminary sampling of 
good and poor workers of the sort under investigation. This 
selected set of tests was given to workers of all degrees of 
ability at a certain operation and each test score correlated 
with the vocational rating. The most promising tests were 
retained, the coefficients corrected for attenuation, partial 
correlations computed and the regression equation derived in 
order to weight the tests and get the best possible prediction 
of vocational ability. After determining the correlation of 
combined weighted test scores with the criterion a table was 
made with deciles of combined weighted test scores tabulated 
for deciles of probable vocational success. It was thus possible 
to predict from the test scores the probability of an applicant's 
being in the highest tenth, next highest tenth, etc. of workers 
in a given operation. These methods were applied to a 
number of rather specialized operations, — finishing, treading 
and building tires, handing out stock and clerical work. With 
the exception of building final correlations between tests and 
criterion of between .56 and .71 were obtained, thus giving 
considerable reliability to the predictions made on the basis of 
the tests. For the less specialized factory operations a general 
intelligence scale was devised to differentiate good from poor 
workers in the average moderately skilled operation and to 
further differentiate these workers from those fitted definitely 
for only unskilled labor. 

These test scales were given to new employees and recom- 
mendations made on the basis of the decile distributions. 
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Effort was made to hire a person for a type of work in which 
he fell in the upper five or six tenths of a normal distribution 
of combined weighted test scores. If unsatisfactory in the 
tests for one operation he was tried in those for another 
until he finally made a good showing or else demonstrated 
his fitness for only unskilled labor. If recommendations ran 
counter to an individual's interests his chances of failure in 
the desired work were explained and an effort made to interest 
him in the recommended work. A man was trained to give 
the tests and continue the work after the writer left the fac- 
tory. The progress in the factory of new help hired on the 
basis of the tests was, at last accounts, vindicating the methods. 
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WHAT INDUSTRY WANTS AND DOES NOT WANT 
FROM THE PSYCHOLOGIST^ 



By EuoTT Frost, Rochester, N. Y. 



Our topic is predicated upon the proposition that Psychology 
is both willing and eager to place at the disposal of industry — 
as it has already done for medicine, education, and the several 
emergencies of the War — its methods and its conclusions. 

There was a time — sufficiently recent for these Emersonian 
walls to have heard and remembered — when to stress the prac- 
tical application of our science, constituted a gaucherie frowned 
upon in some of the highest circles. If recent literature re- 
flects inner conviction, ^t day is happily past, and consola- 
tion may be given the mourners by those of us for whom such 
a time never existed — for nothing good has really died. Our 
plight was due, first, to the youthfulness of our science, which 
felt it proper enough to be seen and not heard— but also to 
certain standards of scholarship professing to find in a liaison 
of theory with practice the liability of offspring for whom the 
assumption of paternity might prove an embarrassment. Medi- 
cine does not suffer as a science because men are healed 
thereby, nor need psychology regret finding itself similarly at 
the service of mankind. Such service as she can render will 
occasion fresh demands for service, and the incentive to search 
and research will grow with the years. It is because I assume, 
then and therefore, the response of the psychologist that I dare 
to speak for industry in terms so categorical. 

Industry is worthy of such help as she needs. The needs 
of industry to-day are unprecedentedly great. These — I take 
it — are two self-evident propositions A part of the dilemma 
of industry, however, is or shortly will become, the multiplicity 
of her doctors and the variety of their pottles. Let me cite 
for you a few examples from the row of industrial panacea. 
Eiach bottle is labeled by those who dispense it, as a " General 
Specific for Industrial Diseases." 

You will not be misled by such a recital into the thought 
that these measures are worthless. On the contrary, I shall 

1 Read at the Annual Meeting of the American Psychological Asso- 
ciation, Cambridge, Mass., Dec. 31, 1919. 
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mention some which I believe to be important, not only, but 
indispensable. The list follows: 

Americanization of the Alien 

Establishment of Bonus Systems 

Better Housing of Employees 

Universal Continuation Sdiools 

Increasing Efficiency Through Diet 

Daylight Saving Laws 

Efficiency Engineering in Factories 

The Establishment of Foremen's Classes 

Find Yourself Campaign for Working Boys 

Graded Wage Scales 

Compulsory Health Insurance 

Industrial Democracy Systems 

Special Legislative Enactments 

Morale Work 

Diagnostic Motion Pictures in the Shop 

Nationalization of Basic Industries 

National Board of Community Speakers 

Psychological Tests 

Questionnaires 

Personnel Ratings 

Systematic Propaganda 

Recreational Athletics 

Rest Periods and Fatigue Studies 

Restriction of Immigration 

Shop Committees 

Employment Management 

Socialism 

Revision of the Metric System 

Excess profits and other Taxation 

Thrift Campaigns 

Unionism 

Vestibule Schools 

Vocational Guidance 

Welfare Work 

This list could be doubled, nor is it a fictitious one. Each 
separate proposition is brought forward by earnest and honest 
men. Each one represents an actual proposal to the writer 
by some man, or group of men, within the last three months. 
Now, it is not the lack of excellence in these proposals, but 
the confusing number of them that constitutes a handicap. To 
be sure, many of them demand a leadership by unusual person- 
alities or extensive and elaborate technique, or both. Even 
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this is, however, the minor difficulty. The tendency to-day, 
despite the gravity of the problems faced, is to reject all 
panacea from a sheer inability to analyze and choose from 
among them. Industry is somewhat in the position of a man 
overboard, liable to perish from the bombardment of life- 
preservers thrown to rescue him. 

Making money is, and broadly speaking must be, the ex- 
pectation of business. The manufacturer must bu^, manu- 
facture and sell to show a profit or cease to do business. If 
the psychologist is to help, he must help make money. He 
must, in short, be both specific and practical. 

Eight or ten years ago, industry was especially concerned 
with Workmen's Compensation Laws and with methods of 
Industrial Safety. Both these research problems are now 
solved with reasonable adequacy. On the other hand, the 
unrest following War has emphasized a new set of problems, 
the major of which are: 

(a) Unionism, (b) Labor Turnover, (c) Selection and 
Training of Foremen, (d) Education of the Alien, (e) Wage 
and Hour Adjustments, (f) Housing, (g) Working Condi- 
tions, and in some States (h) Compulsory Health Insurance, 
(i) Taxation, (j) Continuation Schools. 

Four of these have special psycholc^cal implications : 

First, Labor Turnover — By Labor Turnover, we mean, 
roughly, the number of men hired in a given industry, per 
year, in proportion to the number of jobs. This varies all the 
way from zero to 8000%. 100% is a small, rather than a large, 
average. That means that the employer having, say a hun- 
dred workers during the twelve months, hires a hundred addi- 
tional workers to fill vacated positions — some of these posi- 
tions, of course, being emptied and filled many times over, 
while others are not disturbed. The annual economic loss in 
this country from Labor Turnover is estimated at one and 
one-half billion dollars, or $50 per head. Practically 50% 
of it is due to lay-offs or discharge. The discharge is usually 
for one of four reasons: Inadaptability, Unwillii^^ess to 
Work, Wrong Attitudes Toward Work, or Positive Miscon- 
duct. The other 50% is due to dissatisfaction. Where turn- 
over is high, dissatisfaction is the chief factor in the turnover. 
It is significant, on the other hand, that when the learning 
period in any job is long, turnover tends to be low; and, in 
general, of course, is lower in the skilled trades. 

Psychology can help the employment manager in his hiring 
and firing and making of transfers within the plant, if it can 
devise a simple — preferably oral — readily applied test, to de- 
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termine three things — (a) Intelligence, (b) Adaptability to 
Particular Tasks, and (c) Temperament. 

In this connection, the well-disposed psychologist, however, 
must remember two hard cold facts : First, That labor in any 
community is usually either very abundant or abnormally 
scarce. If abundant, rough empirical tests, with recommenda- 
tions do very well. If scarce, the man will be taken on any- 
how whatever his mental rating. Second, We need to remem- 
ber that vocational training does not place a man. The Law 
of Supply and Demand, and not his ambitions or aptitudes, 
determines the career of most men in industry. 

A second timely problem, in which the psychologist has 
proper concern, is that of Americanization. This involves the 
education of the illiterate and of the foreign-bom, both in Elng- 
lish and in American ideals. 

An analysis of racial psychology and the application of par- 
ticular educational methods, devised to meet the educational 
problems of the several races, has not yet been made, so far 
as the speaker is aware. The failure of some of the most 
ambitious attempts to minister to industrial needs during the 
last four years, has been due to the failure properly to edu- 
cate. At one plant, for instance, of 800 employees, in spite 
of an elaborate and particularly successful shop committee 
system, an analysis of the workers showed that SOD of the 800 
were either foreigners or illiterates, and had no conception of 
the machinery set up in their behalf. They, therefore, went 
out on strike. 

If the Swede, the Pole, the Italian, the Greek, are to be 
taught the advantages of industrial democracy, the lesson must 
be built upon the background of a proper racial psychology. 

There is, for instance, more than ja mild tendency to racial 
monopoly in certain industries. The French Canadians drift 
toward the cotton factories, copper mining, smelting, boots 
and shoes — the Croatians toward the mines, steel and the 
filthy trades — the Danes toward leather, furniture, collars and 
cuffs — the Dutch toward silk-making, dyeing, furniture fac- 
tories, and the like — ^the Armenians toward cigarette making 
and peddling — Greeks into the blacksmithing, baking, shoe- 
making, boot-blacking and the like — Hebrews into the small 
manufacturing of the sweat-shop variety — Chinese into im- 
porting — French-Swiss into the hotel and restaurant business, 
silk industries and embroideries, and so on. 

Again, certain races are easily assimilated. For instance, 
the French-Swiss, Ukrainians, Russians, Poles and Japanese. 
Others are distinctly clannish, as the Slovacs, Armenians, Al- 
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banians, Portugese and Chinese. Such social characteristics 
of the various nationalities are clearly reflected, both in their 
work, and in their relation to the industry. 

The laborer's attitude toward industrial relations is deter- 
mined by his nationality more than any other single factor. 
The Jew, for instance, demands an arrangement in which he 
can bargain. He is continually thinking of how much he is 
receiving for his labor. He is really more conscious of his 
labor organization and its methods than he is of his creative 
labor faculties. As a thinker, he is usually of the radical 
stamp. The Italian's highly emotional nature lends itself 
readily to directions by the organizers. It is the testimony 
of the executives that he cannot be trusted without reserva- 
tions, and that he is apt to be sullen and moody. The German 
workman is of placid disposition, loves detail, is particularly 
effective on precision work. The Pole and Croat usually do 
the dirty work in the plant. For instance, in the grinding of 
lenses, a job in which the workman becomes covered with 
damp red pumice, the Poles predominate. 

In any Americanization program then, educational methods 
must vary with nationalities involved. The ideal method of 
reaching the slow-moving, generally placid Swede will not 
serve for the emotional Italian ; nor that adapted to the keen- 
witted Jew for the average German mechanic in the shop. 

These facts and tendencies indicate a distinct problem in 
race psychology, but one applicable in its solution to the work- 
man at the bench. Racial characteristics affect quality and 
quantity of work. They affect adaptability, willingness to 
work, attitude toward work, and misconduct — the four basis 
criteria of discharge. 

In short, an industrial psychology has still to be written^ 
although the need for it has long been great. 

In connection with the Continuation or Part-Time SchooU 
psychology, and especially educational psychology, can render 
a third service to industry. Such a school, inaugurated some 
18 years ago in Chicago, is noW permissive in Massachusetts, 
Ohio, Michigan and several other States, and compulsory 
in Wisconsin, Pennsylvania and New York. It provides for 
the continued schooling, on the employer's time, either in the 
arts and sciences, in civics, or in vocational work, from 4 to 
8 hours a week, of all youth in industry, and who have no 
education beyond the grade school. 

If this Law is not to operate as a handicap upon the em- 
ployment of such workers, it must justify itself by the increase 
of efficiency through a sound educational program. This. 
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efficiency will be measured by the employer — whether we like 
to face this fact or not — in terms of dollars and cents. Can, 
then, the psychologist offer a suggestion as to the best method 
of instruction, the best time of day within the factory schedule,, 
the wise allocation of hours during the week ? Can he advise 
as to whether such instruction should be by racial groups, or 
to a mixed group of all races? Can he hope to show the 
employer a relation between broad education and production 
units? 

The fourth and perhaps most important service renderable 
to industry by the psychologist, concerns the foreman. The 
War Labor Board claims that 98% of industrial disputes faced 
during the War, led back to the foreman. The foreman is the 
Army Top Sergeant. The passed buck reaches him. He 
must handle men mentally and physically. Until recently, the 
emphasis was upon the physical. Under newer ideas and 
ideals of persuasion, therefore, industry now finds itself sad- 
dled with men, whom it has taught to be " hard-boiled." These 
petty officers, either in industry or War, can make or break 
morale. Foremen, therefore, and prospective foremen, must 
be selected and trained for their jobs. The attitude between 
the foreman and the man at the bench, depends in part, upon 
the power the foreman holds. If he can hire and fire at will, 
methods of persuasion are less likely to be used. Two modem 
industrial tendencies are helping in the solution of this problem : 

First, The centralization of employment, whereby the hiring 
and firing is taken out of the foreman's hands; and 

Second, The vestibule-school idea wherein the foreman be- 
comes a teacher to the man at the bench. 

These are both steps in the right direction. While the 
major task of the true foreman is that of problem-solving, 
he will always remain a manipulator of human material, and 
the product which leaves his room will continue to reflect his 
success or failure in dealing with psychological factors. At 
present, the average foreman is rarely a teacher, but he is a 
man, usually, who can DO. Tests devised by the psychologist 
to aid in the selection of foremen should, then, have in mind 
three qualifications: 

First, Ability to solve problems. 

Second, Ability to handle men. 

Third, Ability to teach the theory of that which one knows 
in practice. 

Industry does not want a booklet of psychological tests. 
The advertised success of the latter in the Army Camps has 
not sold the idea to the manufacturer. He must be shown the 
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value of any technique by patient education and proved results. 
The psychologist must not become " cocky." He is already 
accused of it. His proposed solutions must check with prac- 
tical experience. He must know concrete conditions; must 
devise his remedial laboratory experiments in the l^^t of them, 
and not sui generis. No time ever needed theories less than 
ours, and no time ever needed facts more. 

If we are to remove the dust from Industrialism and give 
the day's work its ancient sparkle, the modem tendency to- 
ward de-personalization and mechanization must be checked. 
When this tendency succeeds, incentive fails — ^the adventure 
of creative work departs — business captures industry for 
profit — ideas become institutionalized, and the workman a 
machine. 

More than tests, analyses, teaching of aliens, or training of 
foremen, the psychologist is helping industry when, knowing 
its problems, he brings to their solution a new vision of the 
importance of psychology itself. 
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A CONSTANT ERROR IN PSYCHOLOGICAL 
RATINGS 



By Edward L. Thorndike, Teachers College, Colombia University 



In a study made in 1915 of employees of two large indus- 
trial corporations, it appeared that the estimates of the same 
man in a number of different traits such as intelligence, indus- 
try, technical skill, reliability, etc., etc., were very highly 
correlated and very evenly correlated. It consequently ap- 
peared probable that those giving the ratings were tmable to 
analyze out these different aspects of the person's nature 
and achievement and rate each in independence of the others. 
Their ratings were apparently affected by a marked tendency 
to think of the person in general as rather good or rather 
inferior and to color the judgments of the qualities by this 
general feeling. This same constant error toward suffusing 
ratings of special features with a halo belonging to the indi- 
vidual as a whole appeared in the ratings of officers made by 
their superiors in the army. 

The official rating plan devised by Walter Dill Scott called 
for separate ratings for Physical Qualities, Intelligence, Lead- 
ership and Personal Qualities (i. e. Character). The instruc- 
tions very emphatically required each of these four to be esti- 
mated independently of the others, as appears from the direc- 
tions quoted below. Yet the correlations of the Intelligence 
rating with the ratings for Physique, Leadership and Character 
made by a very conscientious officer in the case of 137 avia- 
tion cadets whose work he, as flight commander, supervised, 
were .51, .58 and .64 respectively. These are all higher than 
reality, plus the attenuation due to erroneous judgments, could 
well give, especially within the restricted range of the com- 
missioned-officer group. They are also too much alike. In 
reality Intelligence and Character or Intelligence and Leader- 
ship should give about three times as close a correlation as 
Intelligence and Physique. 

" How to Make the Scale. 

3. Make a list of about a dozen officers of your own 
rank and not above the average age of officers of this 
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rank. They should be men with whom you have served 
or with whom you are well acquainted. Include officers 
whose qualifications are poor or mediocre as well as those 
who are highly efficient. This list serves merely as a con- 
venient reservoir of names; the names actually used in 
the scale may include others. 

4. Look over your list from the viewpoint of Physical 
Qualities only. Disregard every characteristic of each 
officer except the way in which he impresses his men by 
his physique, bearing, neatness, voice, energy and endur- 
ance. Select that officer who surpasses all the others 
in this qualification and enter his name on the line marked 
highest under Physical Qualities. Now select the one who 
most conspicuously lacks these qualities and enter his 
name on the line marked lowest. Select the officer who 
seems about half way between the two previously selected 
and who represents about the general average in physical 
qualities; enter his name on the line marked middle. 
Select the officer who is half way between the middle and 
the highest; enter his name on the line marked high. 
Select the one who ranks half way between middle and 
lowest; enter his name on the line marked low. 

5. In the same manner make out scales for each of the 
other four sections (Intelligence, Leadership, Personal 
Qualities and General Value to the Service). 

How to Use the Scale. 

6. Rate your subordinate for Physical Qualities first. 
Consider how he impresses his men by his physique, bear- 
ing, neatness, voice, energy and endurance. Compare him 
with each of the five officers in section I of the Rating 
Scale, and give him the number of points following the 
name of the officer he most nearly equals. If he falls 
between two officers in the Scale give him a number ac- 
cordingly (e. g. if between Low and Middle give him 7, 
7y2 or 8). 

7. Rate the subordinate in a corresponding manner for 
each of the other four essential qualifications. Under III 
(Leadership) and V (General Value to the Service) con- 
sider which officer he will most nearly equal after equiva- 
lent experience. 

Points for Special Attention. 

9. In making or using any section of the scale, con- 
sider only the qualification it covers, totally disregarding 
all the others. 
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I. Physical Qualities. 

Physique, bearing, neatness, voice, energy and endur- 
ance. (Consider how he impresses his men in the above 
respects.) 

II. Intelligence. 

Accuracy, ease in learning, ability to grasp quickly the 
point of view of commanding officer, to issue clear and 
intelligent orders, to estimate a new situation, and to 
arrive at a sensible decision in a crisis. 

III. Leadership. 

Initiative, force, self reliance, decisiveness, tact, ability 
to inspire men and to command their obedience, loyalty 
and co-operation. 

IV. Personal Qualities. 

Industry, dependability, loyalty, readiness to shoulder 
responsibility for his own acts, freedom from conceit and 
selnshness, readiness and ability to co-operate. 

V. General Value to the Service. 

His professional knowledge, skill and experience; suc- 
cess as an administrator and instructor; ability to get 
results." 

The same effect appears in the ratings given by other offi- 
cers. The correlations are too high and too even. For 
example, for the three raters next studied the average corre- 
lation for physique with intelligence is .31 ; for physique with 
leadership, .39 ; and for physique with character, .28. 

The same constant error appears in the correlation of the 
total Scott rating with a rating for technical ability as a flyer 
in the case of aviation officers. It is known from abundant 
evidence that technical ability as a flyer is a rather highly 
specialized quality.* Considering the restricted range of the 
aviation cadets, the correlation between general ability for 
officer work and technical ability as a flyer could hardly be 
above .40, without any attenuation. As attenuated by the 
imperfections of the rater's knowledge of both, it could hardly 
be above .25. Yet the correlations for the eight raters studied 
in this respect are .74, .85, .52, .91, .63, .72, .47 and .53, an 
average of .67. Obviously a halo of general merit is extended 
to influence the rating for the special ability, or vice versa. 

Mr. Knight of Teachers College has studied this same 
effect in the case of 129 teachers rated by their superior officer 

* See " The Selection of Military Aviators : Mental and Moral. 
Qualities." U. S. Air Service, June 1919. 
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for certain qtialities on the Boyce score card. The ratings in 
queistion were official and were used to determine salaries and 
promotions. General merit as a teacher has correlations of 
.68 with intellect, .79 with power in discipline, and .63 with 
voice. It is clear that the rating of a teacher's voice must 
have been influenced by the general impression of her ability. 
Voice correlates .50 with " Interest in Commtmity Affairs/' 
and .63 with intelligence ! 

The correlations reported in the original study by Boyce 
show this same effect. General merit as a teacher is reported 
to correlate as follows : 

With General Appearance 47 

" Health 56 

" Voice 53 

" IntcUcct 62 

" Initiative and self reliance 77 

** Adaptability and resourcefulness 80 

" Accuracy 74 

" Industry 69 

" Enthusiasm 71 

** Integrity and sincerity 63 

" Self control 66 

** Promptness 66 

" Tact 69 

" Sense of Justice 61 

** Academic preparation 41 

" Professional preparation 38 

etc. etc. 

(The last is the lowest of the forty-five correlations reported.) 

In the cases so far the correlations are a resultant of (1) 
the real facts, (2) the constant error of the "halo," as we 
may call it, and (3) the reverse error of attenuation due to 
chance inaccuracies in the ratings. In certain further work 
by Mr. Knight the correlations are freed from the last influ- 
ence, by being based on the composite rating of two groups, 
each of a number of teachers who knew the individuals to 
be rated fairly well. The self-correlations of the ratings by 
one such a group with ratings for the same trait by the other 
group are over .90. The correlations for general ability as 
a teacher with intellect and with ability to discipline are about 
.95 and .80 ! The correlation of intelligence and ability to dis- 
cipline is about .80! The correlations of a standard test of 
intelligence with general ability as a teacher and with ability 
to discipline are, for the individuals in question, not over .3. 

The writer has become convinced that even a very capable 
foreman, employer, teacher, or department head is unable to 
treat an individual as a compound of separate qualities and 
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to assign a magnitude to each of these in independence of 
the others. The magnitude of the constant error of the halo, 
as we have called it, also seems surprisingly large, though we 
lack objective criteria by which to determine its exact size. As 
a consequence science seems to demand that, in all work on 
ratings for qualities the observer should report the evidence, 
not a rating, and the rating should be given on the evidence to 
each quality separately without knowledge of the evidence 
concerning any other quality in the same individual. 
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PSYCHOLCXilCAL TESTS AS DIAGNOSTIC OF VOCA- 
TIONAL APTITUDES IN COLLEGE WOMEN 



By Elsie Muuay, Sweet Briar College, Virginia 



The use of tests in the diagnosis of the academic difficulties 
of college freshmen, or in the sifting of the qualifications of 
applicants for admission, is now sufficiently familiar. Their 
application to the differential study of members of the gradu- 
ating classes and of their fitness for various fields of activity 
is less widespread. Under the stress of war-time conditions, 
and the resultant necessity of recommending women g^duates 
to a wide variety of positions, the following attempt to extend 
and adapt the technique of psychological testing to the latter 
problem was made by the writer. 

Tests Utilised, Four Series. A series of tests already 
under way in the junior and senior classes of a woman's col- 
lege (numbering 36 and 32 respectively), in illustration prin- 
cipally of certain routine topics in the courses in general, 
experimental, social, and educational psychology, was further 
extended. The tests were then divided into four sets accord- 
ing as they were judged roughly from past experience to be 
suitable measures of the ability to handle ideas, symbols, things 
or people (captions borrowed with certain alterations from 
Thomdike). Each set, after considerable shifting, contained 
(with the exception of the fourth) ten distinct tests, repre- 
senting roughly two hours actual classroom time each, dis- 
tributed over a period of about a year and a half. The tests 
utilized were for the most part standard ones, supplemented 
by a few original with the author. The group method was 
usually employed, though a few were individually admin- 
istered. The first series contained tests in controlled asso- 
ciation, logical memory, completion, proverb matching, gen- 
eralisation, information, etc.; and will be referred to as the 
Reasoning or R series. The second was made up of rote 
memory, rote learning, addition, spelling, cancellation, easy 
directions, and related tests, and will be known as the Accuracy 
or A series. The third, or " Practical Ability " or P series, 
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contained tests of motor dexterity and alertness to surround- 
ings, such as tapping, card sorting, aussage, construction pus- 
zle, weight suggestion, divided attention, etc. The fourth, or 
" Social Ability " set, comprises a series involving judgments 
upon personal attributes, situations, and facial expression of 
the emotions, referred to as S series. 

Evaluation of the Scores. Pooling. The results were evalu- 
ated as follows: Elach test was scored on a point system 
(empiricallv determined and somewhat approximating a per- 
centile ranking) for both speed and accuracy, the maxunal 
credits assigned to any test being usually ten points. The 
scores within each set were then pooled, and each student 
assigned a rank (1 to 36 or 1 to 32) on the basis of each of 
the four combined scores (R, A, P and S). While a small 
number rank high on all four ratings, this procedure was suc- 
cessful in differentiating each class roughly into four groups : 
one, of those doing better in R than in any other series; 
another, in A; another in P, etc. The correlations^ between 

.=1- '^ 
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the scores for the four test series range from +.05 for A and S 
to -f .68 for R and S. 

Interpretation of the Resultant Ratings. The significance 
of the differentiation of individuals thus secured was meas- 
ured roughly by comparison of test ratings with classmates', 
instructor's, and self estimates of I (intelligence), A, P and 
S abilities, and with academic g^des. The classmates' esti- 
mates were obtained by having each subject arrange the names 
of all the members of her class in order (1 to 36), according 
to the degree of the ability in question which she believed each 
to possess. The median position of each individual for each 
trait was then calculated, and a composite ranking representing 
the group judgment obtained for general intelligence, accuracy, 
practical and social ability, respectively, for toth classes; an 
additional estimate on teaching ability for 1918. This method 
(of relative position) was found to )rield higher reliability 
coefficients (ranging from .82 for S to .97 for I) than were 
secured by the seven or nine grade system. 

1. The correlations of test rankings with the corresponding 
estimates were as follows, for the R, A, P and S abilities : for 
1918, .63, .30. .12, and .19 respectively; for 1919 (with im- 

*AU correlations were figured by the Spearman *Rank-DiflFercnces' 
formula. 
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proved methods of giving and scoring) .73, .36, .53, .26. The 
corresponding correlations for tests and instructor's estimates 
(the writer's was the only one available)* are, for 1918, .84, 
.79, .50, .44; for 1919, .83, .71, .59, and .65. While the co- 
efficient for reasoning tests and intelligence estimates (both 
classmates' and instructor's) is high (averaging .68 and .835 
for the two classes),* as compared with similar measures 
quoted by others (see Hollingworth, for classmates, .62; Kit- 
son, Ruml, Thurstone, Abelson, and Webb, for instructors, 
average .57, .66, .60, .58, and .545, respectively), the cor- 
relations for the A, P and S abilities are less striking. The 
latter are, however, for the most part higher with the improved 
methods of 1919; higher also for instructor's than for class- 
mates' estimates. 

The real significance of these figures (slight, it must be 
admitted, in certain cases), the possible weaknesses of both 
tests and estimates, as well as certain differences between 
faculty and student estimates, are best brought out by the 
complete tables of correlations and cross-correlations. Cer- 
tain inherent shortcomings of either P tests or estimates, for 
instance, would seem to be indicated by the fact that the P 
estimates of classmates and instructor correlate as well or 
somewhat better with A than with P test scores. On the 
other hand, the closer correlation of classmates' (not instruc- 
tor's) A estimates with P than with A test scores is probably 
to be attributed merely to a slip in the instructions forming 
the basis of the A estimates in 1919, in which manual rather 
than clerical accuracy was emphasized. Finally, the higher 
correlation of classmates' estimates of S ability with R than 
with S test scores challenges explanation: while undoubtedly 
due in part to an inadequate differentiation of the R and S 
test series, it is in part also to be attributed to the difficulty 
of securing reliable estimates of the quality aimed at, the 
students tending in man^ cases to substitute a judgment based 
upon superficial amiability of manner, for the actual esti- 
mate of tact and sympathetic understanding of human nature 
which was sought. 

^The correlation coefficients between instructor's and classmates' 
estimates for I, A, P and S average .77, .61, .28, and J5 for 1918 and 
1919. 

^The exact degree of correlation involved may be clarified by the 
following statement : the coefficients of .63 and .7Z for class I estimates 
and R tests mean respectively that, in 1918 and 1919, 72 and 81% of 
thc^se scoring above the median in die tests, ranked also above the 
median in the class estimates. 
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CORRELATION TABLES FOR CLASS OF 1919 

Classmates' Estimates Instructcmi's Estimates 

Tests I A 

R .71* .19 

A .45 .36 

P .53 .43 

S .39 -.23 

♦With the one exception indicated, these are all positive. 

2. The correlation of test ratings and academic standing 
was next attempted, bringing to light an apparent variation 
in the reliability of grades from year to year, or class to class ; 
further, the relative unreliability of freshman as compared 
with upper class marks. The correlation, for instance, of 
academic standing with R tests drops from .71 in 1918 to .46 
in 1919; with instructor's estimate of intelligence, from .80 
to .68; with classmates' from .86 to .58; with instructor's 
estimate of teaching ability, from .81 to .55 (and this at the 
same time that the coefficients for classmates' estimates of 
intelligence and R tests rise from .63 in 1918 to .73 in 1919; 
for instructor's estimate of teaching ability with R tests from 
.70 to .80, with combined RAPS scores from .75 to .82). 

This collapse of the correlation coefficients for academic 
standing in 1919 was traced to two sources. First, to the fact 
that for this class freshman and sophomore grades only (in 
required courses) were utilized, while in 1918 junior grades 
had been included; elimination of the latter in calculating 
1918's standing reduces the correlation with R tests from 
.71 to .60, with intelligence estimates (classmates'), from 
.86 to .77. More particularly, the drop in the 1919 coefficients 
appears to be correlated with the presence in the class of 
two members of considerable natural ability, but of indif- 
ferent academic ambitions, especially in the earlier years of 
their college course; elimination of whose scores raises all 
of the 1919 grade correlations. In the opinion of the writer, 
the facts warrant the assumption of the superior value, year 
in and year out, of R test ratings over academic grades, as 
measures at least of potential ability. 

Corroboration of our hypothesis as to the superior reliability 
of grades from the later college years is apparently furnished 
by the corresponding correlations (of R tests and grades) 
reported by others workers ; e. g., .20 for freshmen, .44 for a 
mixed group of freshmen, juniors, and seniors (Kitson) ; .42 
for juniors, .57 for seniors (HoUingworth) — note the ascend- 
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ing series. The possible explanation, that mechanical memory 
work is the determining factor in freshman and sophomore 
grades, as against initiative and reasoning ability in the upper 
classes, is not, however, supported by the relatively low cor- 
relation of grades and A test scores for 1919/ Freshman 
instability and irresponsibility, or variations in the standards 
and personnel of the instructing force are presumably the 
principal sources of the discrepancies and inconstancies noted. 
Scrutiny of the table of correlations for test scores and 
grades in particular subjects brings to light other facts of 
interest. For 1919 (the test scores for which are regarded 
as more reliable), the study correlating most closely with R 
test scores is English (+./4) ; this subject, moreover, pves 
decidedly lower correlations (+-31 to .36) with all other 
test sets. The study yielding the highest correlation with A 
test scores is Mathematics; the figure, to be sure, is low 
(+.34) and is followed closely by 3ie Latin and English co- 
efficients. However, the correlation of Mathematics with all 
other test groups is lower (+.02 to — .19). While the sub- 
ject correlating most nearly with the P tests is English 
(+.34), Science is a close second (+.31, P. E. =.105) ; more- 
over, the correlation of Science with all the other test sets is 
lower (+.26 to — .01). Lastly, the subject correlating the 
most closely with S scores is History (+.64), and the corre- 
lations of the three other sets of scores with this subject are 
all lower (.57 to .10). 

Correlation op Test Scores and College Scores 

Tests Latin Mathe- Science English History Modem 

matics Language 

.37 

.20 

.10 

.30 

Whether or not these correlations will be found valid for 
other colleges or classes remains to be proven. The relation- 
ships anticipated had been, it may be noted, between Latin 
and R tests, Mathematics and A tests, Science and P tests, 

^The complete correlation table for test scores and grades is as fol- 
lows: for 1918, for R, A, P, S and total test scores, .71, .64, .31, .48, 
and .75; for 1919, .46, J3, 26, .24, and .45. 
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and either English or History and S tests. The significance 
of the (actual) English and R test correlation is ambiguous. 
Does it indicate a combination of R tests too closely de- 
pendent upon verbal facility and vocabulary?* the superior 
value of achievement in freshman English as a criterion of 
general ability ? ; or merely the superior reliability of the Eng- 
lish instructors' judgments? The virtuallv zero correlation 
of Mathenfiatics grades (for 1919) with all but A tests gives 
rise to further speculation. Is it possible that success in college 
Mathematics presupposes, at least in women, a specialized 
talent existing, as often as not,* at the expense of or in inverse 
ratio to humanistic interests and practical abilities? 

3. Finally, each student was asked to register the line of 
work for which she believed herself to be best adapted. In 

1918, when an option of three lines of work only was offered, 
in a class of thirty-six, 11 registered for teaching, 13 for 
clerical or secretarial work, Iz for practical. Of the 13 
registering for clerical work, 8 (61.5%) score in the upper 
third of die A test ranking; of the 11 assigned to teaching, 
6 (54.5%) appear in the upper third of the R test ratings; 
while of the 12 signing for practical work, only 3 (25%) 
are found in the upper third of the P test ranking, although 
48% score higher in this than in any other test rating. In 

1919, of those mentioning, clerical work, 62.5% rank in the 
upper third of the A tests ; of those mentioning teaching, 50% 
in the upper third of the R tests ; of those mentioning social 
work, 46% in the upper third of the S test scores; of those 
signing for practical work, 37.5% in the upper third of the 
P test rating, while 43.5% do better in P tests than in any 
other set. 

Conclusions, From the point of view of vocational guid- 
ance, the present study can be regarded as tentative only; 
both the experimental procedure and the securing of estimates 
demand mcKiification, and checking up bv post-graduate study 
of the individual. At the same time, the probable existence 
of distinct aptitudes which fit or unfit the individual for one 

* Against this construction may be cited the high correlations of Eng* 
lish grades with instructor's I estimates (.71 and .64 for 1918 and 
1919) ; and with classmates (.70 and .77). 

* In this connection, it is interesting to note that the correlation be- 
tween freshman Mathematics and English for 1918, is +.555, for 1919, 
only + .08. It is iK>ssible, of course, that in larger, more representative 
groups this relationship would exhibit more constancy. The corres- 
ponding figure quoted by Tolman (Journal of EducaHonal Psychol- 
ogy, February, 1919) for 27 freshmen is .47 ±10; by Uhl, for 100, .48, 
ibid., Jan. 1919; by Bell ibid., Sept. 1916, for 750, .46. 
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of the four lines of work mentioned seems to be fairly demon- 
strated by the degrees of difference manifest in the four test 
ratings. Whether these aptitudes are innate or acquired, 
whether they depend upon specialised abilities (unit traits), 
upon interests derived from a variety of factors, or are 
merely the by-products of varying degrees of general ability, 
is not our immediate concern. Careful weighing of the data 
in hand, however, inclines the writer to the view that degrees 
of intelligence, seconded by certain physical and temperamental 
peculiarities, play an important role. While certain gifted 
individuals may display ability along all four lines, only those 
lacking in ideas and originality are likely to satisfy them- 
selves for any period with purely clerical activities; few pos- 
sessing them are likely to content themselves with, or give 
undivided attention to, work largely manual or practical. The 
actual bar to clerical or practical activities, however, may be 
primarily defective eyes, a nervous temperament, or natural 
clumsiness of hand. It is, moreover, an interesting specula- 
tion as to whether variations in instinctive endowment, excess 
or deficiency in the social and sympathetic instincts, in curiosity 
(as manifest in alertness of the senses, and a natural turn 
for manipulation), in facile sensory motor learning, may not 
play a part in determining inclination toward or away from 
social, practical, or intellectual work ; or whether a differentia- 
tion in the degree of development of the motor centres for the 
larger and the smaller muscles may not lie at the root of a 
preference for or an aversion to practical or clerical work. 

Pending more definite knowledge along these lines, the use 
of class estimates and of tests of the variety here described 
will be found invaluable in stimulating the student to more 
careful weighing of alternatives and qualifications in the choice 
of a vocation; in accentuating the need of more adequate 
preparation; and, incidentally, in demonstrating the value of 
a wider range of choice in electives, to counteract the tendency 
toward too narrow specialisation so often revealed. 

The time and labor thus expended may be further justified 
by the amount of light thrown upon undergraduate problems 
of a more purely academic nature by the test data. General 
tendencies, such as too complete a reliance upon verbal mem- 
ory, defective habits of concentration or self-control, lack 
of expressive facility, of abstract or general ideas or of the 
ability to form spontaneous generalisations, habits of care- 
lessness, the tendency to sacrifice accuracy to speed, an unde- 
veloped social consciousness, inefficiency in handling one's 
ordinary working materials, may all be isolated and magnified 
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by the range of tests here advocated, and the student advised 
accordingly. If the individual is looking forward to teaching, 
or to clerical or secretarial or social work, the professional 
motive may be utilized to stimulate effort along lines where 
weakness in the necessary elementary processes or qualifica- 
tions can be demonstrated. 

In the case of students involved in academic difficulties, the 
R tests may disclose a coefficient of intelligence so low as to 
render a satisfactory solution of their college problems un- 
likely; at the same time their A, P or S scores may indicate 
a practical (or other) ability sufficient to warrant the attempt 
to divert their ambitions from the conventional teaching career 
to lines of work more suited to their actual abilities. On the 
other hand, the discovery of a high intelligence coefficient in 
the unambitious may be utilized to induce the adoption of a 
more serious attitude toward college opportunities. 

Sumtnary 

1. Scores obtained from a series of tests distributed over 
a number of months in the junior and senior years, when 
pooled in four sets to measure General Intelligence (or Teach- 
ing Ability), Accuracy (or Clerical Ability), Practical and 
Social Ability, respectively, afford evidence of decided dis- 
similarity in the four functions measured. 

2. Classmates' estimates of each other's ability furnish addi- 
tional information of vocational interest, and to a certain 
extent corroborate the findings of the tests. 

3. College grades based upon freshman and sophomore 
courses appear on the whole to be less reliable than those of 
later years^ as indicators of real ability and differentiation 
of talents. 

4. Comparison of the student's own vocational choice with 
the various test scores reveals a fairly high degree of corre- 
spondence between individual ambition and experimental 
findings. 

5. The test data accumulated are applicable to a variety of 
academic problems. 
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THE APPLICABILITY OF MENTAL TESTS TO 
PERSONS OVER FIFTY YEARS OF AGE 



By Josephine Curtis Foster,* Formerly Chief Psychologist, and 
Grace A. Taylor,* Formerly Psychological Interne, Psycho- 
pathic Hospital, Boston 



In psychological examinations made at the Psychopathic 
Hospital it has for some time seemed evident to the examiners 
that the majority of patients over 50 years of age do especially 
poorly in the tests of memory and in certain allied tests. 
Casual observation and another study* showed further that 
this deficiency depends relatively little upon type of mental 
disease and relatively much upon chronological age. The 
present paper is an account of our attempt to find reasons 
and numerical expression for the differences among our 
patients. We have attempted also to check our results by 
stud)ring the influence of chronological age in the case of nor- 
mal persons. 

Cases Used and Their Comparability 

The following groups of cases have been studied. No 
foreign-speaking adults and no children of foreign-speaking 
parents are included in any group. 

(a) 106 older* patients in a large general hospital in Bos- 
ton (not an insane hospital). 

76 per cent of this group are men. So far as our problem 

^ Our thanks are due to the following physicians whose cooperation 
made possible the work on the normal old persons: Drs. John J. 
Dowling, Edmund W. Wilson, John L. Ames, John Bapst Blake, W. £. 
Faulkner, E. N. Libby, Edwin A. Locke, H. A. Lothrop, Paul Thorn- 
dike, and Townsend Thomdike. We wish also to thank Dr. F. H. 
Thomas for allowing us to work at the Foxboro State Hospital, and 
Dr. R. M. Yerkes for allowing us to use the data on school children. 

^To be published shortly by J. C. Foster under the title ''Significant 
Responses in Certain Memory Tests." 

* Older, in this paper is taken to mean 50 or more years of age. 
Younger is to be understood similarly as less than 50 years of age. 

39 
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40 FOSTER AND TAYIXH^ 

is concerned, however, a study of the cases reveals no signifi- 
cant influence of sex upon results. 

This hospital charges up to $10 a week where payment 
is exacted, but admits patients free when their families are 
unable to pay for treatment. 59 per cent were manual laborers. 
The average social status of the patients of this group is, 
therefore, relatively low. 32 per cent of them, for instance, 
left school before the 5th grade, and 85 per cent of them 
before the 9th grade. 

All of these patients were given the Yerkes-Bridges Point 
Scale by the second writer. Our original plan was to include 
also several additional memory tests, but they had to be aban- 
doned. In the first place, many of the patients had too poor 
eyesight to be given any " visual verbal " tests. But more 
than this, many of the older persons objected to attempting 
any memory test. At the mere hearing of the directions 
" when I am through reading I want you to tell me as much 
as you can of what I read " many of this group made such 
remarks as "Oh, no ! I couldn't do that " or "Oh, no ! my mem- 
ory is top poor for that " or " That is child's play, don't try 
an)rthing like that on me." The true reasons for refusal evi- 
dently were the conviction that their memory was poor and a 
reluctance to display this weakness. In general we found in 
working with normal older persons a similar reluctance to 
undertake other " difficult " tests. Some half dozen cases, for 
example, had to be discarded because the patient refused to 
attempt any test after the twelfth, that is to say, when the 
thirteenth was given, they would not attempt it, nor would 
they attempt any succeeding test. We were therefore forced 
to be content with giving the Point Scale alone. 

(b) 315 normal young men between ages 20 and 30. This 
group is distinctly inferior in social status and education to 
the above group. 79 per cent were manual laborers. 65 per 
cent of them left school before reaching the 5th grade, and 
96 per cent left before reaching the 9th grade. All of these 
cases were given the Point Scale (omitting tests 14 and 18) 
by other examiners, but all scoring was checked by us. Tests 
14 and 18 were omitted because the majority of the group 
had too little schooling to be able to do any of the tests involv- 
ing sentence construction. 
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(c) 316 normal school children between ages 10 and 19. 
These cases were from the Cambridge public schools and were 
tested in obtaining the original norms for the Point Scale.* 
Their average social status is at least as high as that of 
group (a). 

(rf) 136 older persons, patients diagnosed psychotic either 
at the Psychopathic Hospital or at the Foxboro State Hos- 
pital. Their social status is comparable with the patients of 
group (a). It is possibly slightly superior. 60 per cent of 
the group are men. 27 per cent only were manual laborers. 32 
per cent left school before reaching the 5th g^ade and 75 
per cent before reaching the 9th. All were given the Point 
Scale by examiners of the Psychopathic Hospital. 

(e) 151 younger persons, patients diagnosed psychotic at 
the Psychopathic Hospital. 52 per cent of the group are 
men. 22 per cent only were manual laborers. 17 per cent left 
school before reaching the 5th grade and 74 per cent left 
before reaching the 9tb. There is no reason to suppose that 
the social status of this group is different from that of the 
above group (d). All were given the Point Scale by exam- 
iners at the Psychopathic Hospital. 

Comparison of Older Psychotic and Younger Psychotic 
Persons {Groups d and e) 

If we temporarily disregard type of mental disease, we find 
that the younger group attains on the average a higher score 
on each test as well as a higher total score. The superior- 
ity of the younger patients is, to be sure, most marked in 
tests 13 (words in three minutes), 14 (three words in one 
sentence), 16 (drawings from memory), and 18 (dissected 
sentences), but we cannot be sure how much the results are 
affected by type of disease and by total score (or mental age). 

If, in an attempt to eliminate the influence of total score, we 
fractionate our cases by total score groups, we find two such 
score-groups sufiiciently large for use, — 53 to 60 (mental age 
10) and 72 to 79 (mental age 13). The data for these groups 
are given in Table 1. 

* See Yerkes, Bridges, and Hardwick, A Point Scale for Measuring 
Mental Ability, 1915, Chap. 4. 
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TABLE 1 
Average Scores op Oli«r and Younger Psrcaonc Persons 

Total Score 53-60 72-79 

AgeGroupe (Mder Younger Older Younger 
Number of Cases 15 18 7 21 

Test 1 3.0 3.0 3.0 3.0 



2 


3.1 


3.2 


3.7 


4.0 


3 


3.0 


2,9 


2.8 


3.0 


4 


3.2 


3.2 


4,1 


4.0 


5 


2.8 


3.9 


4.0 


3.9 


6 


3.4 


23 


4.2 


3.2 


7 


6.6 


8.0 


8.5 


8.6 


8 


.8 


1.1 


1.5 


1.9 


9 


3.8 


4.0 


5.0 


5.3 


10 


4.2 


4.5 


6.4 


6.1 


11 


1.8 


2.4 


2.7 


ZO 


12 


3.1 


3.6 


4.0 


3.8 


13 


1.4 


1.3 


2.2 


2.6 


14 


.8 


.9 


2.2 


3.1 


15 


5.5 


4.3 


7.1 


7.0 


16 


.1 


.7 


.7 


1.7 


17 


2.2 


1.4 


3.2 


3.9 


18 


.2 


1.3 


3.1 


4.1 


19 


3.2 


2.0 


5.1 


4.1 


20 


1.4 


2.1 


2.8 


2.7 



From the results given in Table 1, we see that the seven 
tests in which there is a decided difference in score obtained 
by the two age-groups (older and younger) are 6, 8, 14, 15, 16, 
18, and 19. The younger attain in test 16 (drawings from 
memory) 343 per cent of the score of the older, in test 18 
(dissected sentences) 164 per cent, in test 8 (arrangement 
of weights) 130 per cent, and in test 14 (three words in one 
sentence), 133 per cent. In test 6 (repetition of sentences), 
on the contrary, the corresponding figure is but 72 per cent, 
in test 15 (comprehension of questions) 90 per cent, and in 
test 19 (definition of abstract terms) 74 per cent. These 
percentages must not be taken to mean too much because 
thus far we have paid no attention to character of disease 
but have grouped all psychotic cases together indiscriminately. 
We have, of course, an entirely diflFerent proportion of some 
mental diseases, such as senile dementia and arteriosclerosis, 
in the two groups. The effect of this factor, therefore, may 
be cuttit^ across the effect of chronological age. 

The effect of type of disease can be eliminated only by 
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considering each disease separately. Unfortunately we have 
only one diagnosis where our cases are sufficiently numerous 
to warrant such comparison. That disease is dementia prae- 
cox. We tried many groupings of total score and of chrono- 
logical age in these cases and arrived finally at seven sub- 
groups each of which had the same range of total score but 
different chronological ages and each of which contained at 
least 10 cases under each age-group. The number of cases 
in some of these age-groups was as great as 52. The sub- 
groups are: Score 46-/1, age 10-19 and 20-29; Score 46-71, 
age 10-29 and 30-49; Score 46-71, age 10-39 and 40-69; Score 
72-85, age 10-29 and 30-49; Score 72-100, age 20-29 and 
30-39; Score 72-100, age 10-29 and 30-49; and Score 72-100, 
age 10-39 and 40^. Score 18-71 gives several groups 
but is too great a range for reliable comparisons. Tne 
comparison of the first twelve tests in the scale reveals nothing 
decisive, for now a younger, and now an older, group appears 
to be slightly superior. When, however, we come to the thir- 
teenth test (words in three minutes) we find that in 5 of the 
7 sub-groups the younger are uniformly better. The younger 
ages with entire uniformity give higher scores in tests 14 
(three words in one sentence), 16 (drawings from memory), 
and in 18 (dissected sentences). Their score is greatest in the 
16th test (about 200 per cent of the score of the older per- 
sons). The older ages, on the other hand, are superior in 
tests 15 (comprehension of questions), 17 (detection of ab- 
surdities) and 19 (definition of abstract terms). Their best 
performance is in test 17 (about 125 per cent). We have not 
given the complete data in these cases because it does not seem 
worth while in view of the relatively small number of cases 
in the groups and in view of the fact that with dementia 
praecox we may not be dealing with a unity after all. 

The general result is that judging from our psychotic cases 
alone and given equal general intelligence, patients over 50 
years of age excel those under 50 in comprehension of ques- 
tions, detection of absurdities, and definition of abstract terms ; 
while they are inferior to the younger patients in construction 
of sentences and drawings from memory. 

Comparison of Older Psychotic and Older Normal Persons 
{Groups a and d) 
In the preceding section we have been careful to insist that 
we have been dealing with results on psychotic patients and 
that it may not be justifiable to infer from them to normals. 
The reader may also be tempted to argue that the changes 
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in score which appear with advancing chronological age may 
be due, not to the influence of age itself, but to the ii&uence 
of the length of time which a patient has suffered from 
mental disease. That is to say, it is to be expected that de- 
terioration will continue with the progress of a mental disease. 
We may have been measuring simply the influence of the 
course of the disease. If so, the psychotic older persons should 
differ markedly from normal persons of the same age. The 
next step, therefore, will be to compare older psychotic persons 
with their normal contemporaries. 

Our groups of psychotic and normal older persons (groups 
a and d) are of approximately the same social level, with the 
former holding the possible advantage. In other regards the 
two groups are also very similar. 

If we consider the groups as a whole and disregard both 
total score and t3rpe of disease, we And that the normal old 
have a higher average total score than the psychotic old, and 
that in most cases they have a higher average score on each of 
the tests. The exceptions are test 13 (words in three min- 
utes) where the averages are the same, and test 14 (three 
words in one sentence) where the older psychotic patients sur- 
pass the older normal persons by one tenth of a point. This 
result in part answers the question we raised above in regard 
to the deterioration of the older psychotic persons. The 
older psychotic persons do show a lower intelligence rating 
than their normal contemporaries. Since they also have, if 
anything, a higher social rating, we must conclude that diis 
greater deterioration is due to the progress of mental disease. 
A question remains, however. Is their greater deterioration 
a quantitative difference simply, or have the psychotic persons 
fallen off in certain abilities while retaining others to a normal 
degree? And further, are our results true for all diseases 
or merely for their average? 

The last question may be answered first and most easily. 
Our cases include dementia praecox, unclassified paranoid 
psychosis, syphilitic psychoses, acute alcoholic and deteriorat- 
ing alcoholic psychoses, manic-depressive insanity and senile 
dementia. If we consider these diseases separately and com- 
pare the results for one with the average attainments of normal 
older persons, we find that the dementia praecox, senile de- 
mentia, and arterio-sclerotic persons differ most from normal 
persons of their age, while manic-depressive and unclassified 
paranoid cases differ least. There is no disease, however, 
which gives results contradictory to our earlier figures for 
the two groups as wholes. 
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We come now to the question of the particular tests in 
which these changes are most marked. To reduce the effect 
of total score, we must once more fractionate our cases 
accordingly. We then find two groups with sizes sufficiently 
great for reliable comparison : those with total scores between 
53 and 60, and those with total scores between 76 and 79. 
From the results thus arranged it appears that the low rating 
of the psychotic cases in some of the tests, at any rate (such 
as words in three minutes, three words in one sentence, and 
drawings from memory) is not due to the fact that the patients 
are psychotic, for normal persons of the same general age, and 
of the same mental rating, do even more poorly in these par- 
ticular tests than do psychotic persons. 

If, then, the particular failures are due not to the disease but 
to chronological age, we should get the same general results 
from the consideration of normal cases. 

Comparison of Older Normal and Younger Normal Persons 
{Groups a, b, and c) 

The results for our normal older persons are briefly sum- 
marized in Table 2. 

TABLE 2 

Average Point Scale Scores of Older N(»mal Persons 



Chronological Age 50-59 


60-69 


70-79 


80-89 


Number of Cases 


55 


34 


13 


4 


Test 1 


3.0 


3.0 


3.0 


3.0 


2 


3.8 


3.7 


3.7 


3.0 


3 


2.9 


2.9 


2.9 


3.0 


4 


3.8 


3.3 


33 


3.5 


5 


3.8 


3.7 


3.7 


3.3 


6 


4.1 


3.9 


3.4 


3.0 


7 


7.8 


7.3 


7.2 


8.0 


8 


1.8 


1.8 


1.6 


2.0 


9 


5.5 


5.6 


5.2 


3.0 


10 


5.9 


5.6 


5.0 


4.0 


11 


2.6 


2.5 


2.3 


1.8 


12 


3.7 


3.1 


3.4 


3.3 


13 


1.6 


1.9 


.8 


1.8 


14 


1.3 


1.0 


.7 


.5 


15 


6.7 


5.8 


5.5 


4.8 


16 


.9 


.3 


.1 


.0 


17 


3.4 


2.9 


3.1 


2.3 


18 


2.6 


2.3 


.7 


.5 


19 


4.4 


3.5 


2.9 


1.5 


20 


2.3 


2.2 


1.3 


1.0 
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From this table we see that in general the total score falls 
off with advancing chronological age among normal persons. 
Of greater importance than the decrease itself, however, is 
the manner of the falling off, that is to say, the particular tests 
in which lowering of score first appears or in which it appears 
in greatest degree. In the table, the small number of cases 
in the highest age-group makes their average scores unreliable. 
We shall, therefore, confine ourselves to the three younger 
age-groups. In these three groups it is evident that with 

TABLES 

Average Point-Scale Scores For Normal Subjects op Three 
Age Groups 

Total Chron. Test 

Score Age 123456789 10 

4^ 52 10-19 (c) 3.0 3.7 2.3 3.4 3.5 ? 6.2 .9 4.1 4.6 
20-29 (b) 2.8 3.4 23 2.5 3.0 2.4 5.8 1.6 4.7 4.6 
50-^ (a) 2.8 3.6 3.0 3.8 3.2 2.4 6.2 2.0 4.8 5.0 

3.0 3.7 2.8 3.7 3.8 ? 8.2 1.5 4.8 4.8 
3.0 3.6 2.9 2.9 3.8 2.7 6.5 1.5 5.1 5.0 
3.0 3.4 2.8 3.3 3.7 3.8 6.6 1.7 4.7 5.1 

3.0 4.0 3.0 3.9 4.0 ? 6.6 1.8 5.1 5.6 
3.0 3.8 3.0 3.3 3.9 2.9 6.8 1.9 5.4 5.5 
3.0 3.6 2.8 3.1 3.7 2.8 7.5 1.7 5^ 5.5 

3.0 4.0 3.0 3.9 4.0 ? 6.9 1.6 5.5 5.9 
3.0 3.7 3.0 3.9 3.9 3.6 6.9 1.9 5.2 5.3 
3.0 3.7 2.9 3.4 4.0 4.9 7.6 1.7 5.6 5.0 

3.0 4.0 3.0 3.9 4.0 ? 7.2 1.8 5.7 6.2 
3.0 3.9 3.0 4.2 3.9 4.1 7.1 1.9 5.7 6.2 
3.0 3.6 3.0 3.8 4.0 5.0 7.5 1.5 5.9 5.6 

3.0 4.0 3.0 3.9 4.0 ? 7.4 1.7 5.8 5.6 
3.0 3.9 3.0 3.0 3.9 4.5 7.4 2.0 5.6 6.1 
3.0 3.8 3.0 3.6 4.0 5.6 8.2 2.0 5.4 5.2 

3.0 4.0 3.0 4.3 4.0 ? 7.3 1.9 5.9 63 
3.0 4.0 3.0 4.3 4.0 4.1 7.8 2.0 5.8 6.5 
3.0 3.8 2.9 3.8 4.0 4.8 8.5 1.5 5.8 6.3 

3.0 4.0 3.0 4.6 4.0 ? 7.9 1.8 5.8 6.9 
3.0 3.9 3.0 4.7 4.0 4.9 8.0 1.9 5.4 6.8 
3.0 4.0 3.0 4.3 4.0 4.5 8.1 2.0 6.0 7.1 

Average for the Above Eight Groups 

4^100 10-19 3.0 3.9 2.9 4.0 3.9 ? 7.2 1.6 5.3 5.8 

20-29 3.0 3.8 3.0 3.6 3.8 3.7 7.0 1.8 5.4 5.8 

50-84 3.0 3.7 2.9 3.6 3.8 4.2 7.5 1.8 5.4 5.6 



53-60 


10-19 
20-29 
50-84 


61-«6 


10-19 
20-29 
50-84 


67-71 


10-19 
20-29 
50-«4 


72-75 


10-19 
20-29 
50-84 


76-79 


10-19 
20-29 
50^ 


80-82 


10-19 
20-29 
50-84 


83-100 


10-19 
20-29 
50-«4 



Digitized by 



Google 



MENTAL TESTS TO PERSCmS OVER HFTY YEARS OF AGE 47 

advancing chronological age there is a tendency for the scores 
in each test to fall off. This tendency is most marked in 
tests 16 (drawings from memory), 18 (dissected sentences), 
14 (three words in one sentence), and 13 (words in three 
minutes). It is least marked; on the other hand, in the very 
easy tests (1, 2, 3, and 5, aesthetic comparison, missing parts, 
comparison of lines and weights, and counting backwards) 
and in test 17 (absurdities). 
When we had reached this point in our investigation, we 

TABLE 3 (continued 

Average Point-Scale Scores For N(»mal Subjects 
OP Three Age Groups 

Test No. of 

11 12 13 14 15 16 17 18 19 20 Cases 

1.6 2.3 1.7 1.2 2.6 1.0 .9 .1 .2 .9 45 
1.8 3.4 .9 ? 4.4 1.0 1.6 ? S 1.1 40 
2.6 2.8 .4 .0 3.4 .0 .0 .0 2.4 .2 5 

1.8 2.9 2.0 1.9 3.2 1.2 1.5 1.4 .7 1.2 61 

1.9 3.1 2.2 ? 4.8 1.2 2.0 ? 1.9 1.0 64 

2.4 3.4 .7 .0 4.4 .0 1.9 .1 2.9 .8 9 

2.2 3.2 2.6 2.7 3.8 1.7 1.7 1.9 1.5 1.6 39 

2.5 3.3 1.7 ? 5.2 1.5 2.0 ? 23 1.1 60 
2.8 3.6 .8 1.1 5.1 .2 23 1.3 3.5 1.2 13 

23 3.4 23 2.8 4.5 2.1 2.1 2.6 2.3 23 31 

2.4 3.5 IS ? 5.7 23 2.7 ? 3.1 1.5 42 

2.6 3.6 2.0 .7 6.0 .7 3.6 13 2.3 2.0 7 

2.6 3.5 2.6 3.6 5.1 1.7 3.6 3.2 3.0 2.4 21 
2.6 3.7 2.2 ? 6.1 1.6 3.2 ? 3.0 1.8 27 
2.6 3.9 23 1.2 6.6 .3 3.5 2.0 3.0 2.5 8 

2.5 3.7 3.3 3.6 5.3 2.5 3.2 3.5 3.3 2.8 31 
2.0 3.5 2.4 ? 7.1 1.8 3.6 ? 4.1 2.1 34 
3.0 4.0 1.6 1.5 6.8 .6 4.4 4.0 4.4 1.8 5 

2.5 3.6 3.4 3.8 7.1 23 3.9 33 3.5 3.2 19 
23 3.9 23 ? 6.6 2.5 4.0 ? 4.1 2.6 26 

2.5 3.7 1.9 2.7 73 3 43 3.1 4.8 2.8 13 

2.6 3.9 3.8 3.8 7.0 3.2 4.0 5.1 4.8 3.9 69 

2.7 3.9 3.1 ? 6.9 3.2 4.4 ? 4.6 3.9 22 

2.8 3.7 2.5 23 7.9 2.1 4.8 4.9 5.8 4.6 17 

Average for the Above Eight Groups 

2.3 33 2.8 2.9 4.8 2.0 2.6 2.7 2.4 23 316 
2.3 3.5 2.2 ? 5.9 1.9 2.9 ? 3.0 1.9 315 
2.7 3.6 1.5 1.3 5.8 .5 3.1 2.1 3.6 2.0 77 
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realized that to make the study complete we needed records 
of normal persons under 50 years of age of the same general 
class as our group of older normal persons. It is regrettable 
that we had not time to continue our work at the General 
Hospital in which we obtained our older normal cases. We 
were obliged to use records obtained by other experimenters 
from other sources. The only records of persons between 
30 and 50 years of age which we could easily consult were 
those of persons so superior intellectually to the cases above 
considered that they were incomparable. There is, therefore, 
a gap at ages 30-50 in our Table (3) which summarizes the 
results of all our normal subjects, including school-children, 
young men and older persons. 

No grade could be given to the school-children in test 6 
because the form of this test has been changed since they 
took, the examination. Neither could any grade be given the 
young men in tests 14 and 18 because so many of this group 
were illiterate that these tests were omitted. For this group 
(d), therefore, the groups of total scores in the left hand 
column should read 46-50; 51-56; 57-61 ; 62-65; 66-68; 69-71 ; 
72-74; and 75-90. In the last section of the table we have 
given the averages of the eight total-score groups. This, to 
be sure, is an "average of averages." Even so, however, 
it is more significant than would be an average of the original 
scores. In the first place, we could not use the simple average 
of scores obtained on each test by each of our age-groups 
because there were so many more high scores among the 
younger that they would have appeared to too great an advan- 
tage. We, therefore, divided our cases in groups by total 
score attained. The averages for these groups may then be 
treated as if they had been " corrected " and as if there were 
an equal number in each total score group, and our " average 
of averages" is, then, the average score attained on each 
test by each age-group, supposing the distribution of total 
scores for the age-groups to be the same. 

From Table 3 it appears that tests 1 (aesthetic compari- 
son), 3 (comparison of lines and weights), 5 (counting back- 
wards), 7 (description of pictures), 9 (comparison of terms), 
and 20 (analogies) show little or no regular change with 
advancing chronological age. Tests 2 (missing parts), 4 
(memory span for digits), 6 (memory span for sentences), 
and 10 (definition of concrete terms) show a slight tendency 
toward decrease with advancing age. Tests 8 (comparison 
of weights), 11 (line suggestion) and 12 (copying square 
and diamond) show a slight tendency for the score to increase 
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with advancing years. The other tests show decided tenden- 
cies. Tests 13 (words in three minutes), 14 (three words 
in one sentence), 16 (drawings from memory), and 18 (dis- 
sected sentences), all show a marked falling-off in score as 
the chronological age increases. This is most marked in 
test 16 (drawings from memory). On the other hand, the 
remaining tests, 15 (comprehension of questions), 17 (ab- 
surdities), and 19 (definition of abstract terms),. show an in- 
crease in score with increased age. From the results we may 
conclude that the improvement in the ability to comprehend 
questions comes fairly early, since our young men are so far 
superior to the school children and are practically the same 
as the older persons. The improvement in absurdities and 
definitions of abstract terms, on the other hand, seems fairly 
regular. The falling-oflF in giving words in three minutes 
seems regular, but in drawings from memory, the score does 
not show any decided decrease until late, that is, the young 
men differ but little from the school children, while the older 
persons are decidedly inferior to the young men. Here again 
we regret that the lack of sufficient data on persons between 
30 and 50 prevents us from more than guessing at the points 
at which the various abilities show changes. 

The main conclusion to be drawn from our work thus far 
is that whether we study psychotic or normal persons with 
approximately the same total score, the yoimger persons tend 
to excel the older in giving words in three minutes, in building 
sentences and in drawing from memory ; while the older excel 
the younger in comprehending questions, in detecting ab- 
surdities, and in defining abstract terms. Our results were 
so consistent throughout that we next turned to the literature 
to see if experimenters who were looking for something else 
had results which agreed at all with ours. 

Results from Previously Published Work 

In our paper on " Significant Responses in Certain Mem- 
ory Tests," (referred to in footnote 2t), in which we consider 
only Psychopathic Hospital cases, some of whom were diag- 
nosed as "not insane," we find no uniform changes with in- 
creasing chronological age in the score of memory span for 
digits. We do find, however, a decided tendency for the score 
of drawings from memory thus to decrease. The point at 
which this decrease begins differed for the diflFerent mental 
diseases, but in all it begins before age 50. A similar decrease 
is found in the scores of memory for short paragraphs. 

Our results in general are also confirmed by a study of the 
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contributions of two other writers. Both of these are reports 
of Binet examinations (one, the Goddard, 1911, and the other, 
the Stanford revision). The differences in grading and in 
the tests themselves make a rough comparison the only one 
possible. 

An article by Wender* gives much valuable material, though 
his conclusion on the basis of his selected cases that his data 
furnish proof for the necessity of a revision of the scatle 
appears unjustified. His Table II shows the tests passed by 
30 cases of senile dementia or arterio-sclerosis, with an aver- 
age chronological age of 74 and an average mental age of 
9.4. From it we have calculated the percentage of the cases 
which passed each test which corresponds to a test on the 
Point Scale. The results of such calculation are given in 
Table 4. 

TABLE 4 

Percentagbop Wender's Cases Passing Tests Similar to Point Scalb 

Tests 

Binet 1911 Test Corresponding Parentage 
P6int Scale Test FwoBiag 

VI, 5 1 87 
Vlf , 3 2 37 

VIII, 5: X, 3; XII, 1 4 65 

Vlli, 2 5 67 

VII, 2: XV, 1 7 67 

IX,5 8 13 

VIII, 1 9 83 

VI, 2; IX, 2 10 70 

XII, 4 11 17 

VII, 4 12 67 
XL 3 13 23 

X, 5; il, 2 14 27 

5C,4 15 57 

X,2 16 7 

XL 1 17 33 

XI, 5 18 27 

XII, 2 19 83 

The most striking points about Table 4 are that test 19 (a 
12-year Binet test) should have been passed by 83 per cent 
of a group whose average mental age was only 9.4 and that 
test 16 (a 10-year test) should have been passed by only ^ 
per cent of the same group. Tests 2 and 8 (missing parts 
and arrangement of weights) also give a low average when 

B ** The Applicability of Binet-Simon Tests in Psychoses of the Sen- 
ium." N. K. Medical Journal, March 6, 1915. 
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we consider the age level to which they presumably belong. 
Test 8 was one of the tests in which our younger psychotic 
patients were superior to the older psychotic patients. Test 2 
was found to change very little until we reached the 80-89 
group of our normal older persons. But, other than this, 
our results do not seem to uphold Wender's findings for 
tests 2 and 8. The successes in Wender's group are more 
striking than the failures. We have already mentioned the 
remar^ble performance in test 19 (definition of abstract 
terms). Tests 15 and 17 (comprehension of questions and 
absurdities) also give venr high percentages. Test 15, a 
10-year test, is passed by 57 per cent of the cases; and test 
17, an 11-year test, by 33 per cent. These three tests, it 
will be remembered, were the three which we found to be 
particularly easy for the older persons, and we may say, 
therefore, that Wender's work supports our results in so far 
as the two have an3rthing in common. 

The second contribution mentioned is in Terman's statis- 
tical account of the bases of the Stanford revision.* From 
this account we have taken the results on KnoUin's unem- 
ployed men (hoboes), chronological ages 21-60, but chiefly 
25-40, mental ages 10-18. The results are summarized in 
Table 5. 

TABLE 5 

Pbrcbntagb op Knolun's Casbs Passing Tbsts at Dipfbrbnt Mental 

Ages 



Stanfacd RevMion 




M '^^^jtmmm^k^^K^^^tt^^Mmm^^m 


Test 




Mental Ages 


Point Scale Test 




10 


11 12 13 14 15 16 


18 


IX, 2 




70 79 


8 


3C,6 
IX, 5 




40 GO 56 GO 


13 


30 


67 75 96 


14 


X5 


70 


85 96 100 100 


15 


X3 


41 


52 67 70 73 


16 


X'2 


SO 


GO 82 81 


17 


\ii,4 




27 54 63 


18 


XII, 2 




50 90 83 97 


19 



The blank spaces in Table 5 seem to mean that if the table 
were completed, there would be zeros in the blanks to the left 
of the figures given and hundreds to the right. It is, of 
course, impossible to determine what these subjects might have 

• Terman and others, "The Stanford Revision and Extension of the 
Binet Simon Scale for Measuring InteUigence," 1917, p. 163 flF. 
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done on the other comparable tests of the Point Scale because 
the arrangement of the Stanford is such that they were not 
given.^ Test 18 (dissected sentences) is very difficult for the 
KnoUin group. Although it is a 12-year test, only 27 per 
cent pass at age, and only 63 per cent of cases with a mental 
age of 14 pass. Likewise test 16 (drawings from memory) 
is difficult, for although a 10-year test, only 41 per cent of 
those with mental age 10 pass it, and only 73 per cent of 
mental age 14 pass. Test 14, again (three words in one sen- 
tence), is done but poorly. On the other hand, test 15 (com- 
prehension of questions), gives percentages which are normal 
for its place in the scale and test 17 (absurdities) is not far 
behind. Test 19 (definition of abstract terms) is evidently 
done better than we should expect from school children. We 
have, then, roughly, though not as decidedly as for Wender's 
older cases, the conclusion that tests 14, 16, 18, and probably 
13 (three words in one sentence, drawings from memory, 
dissected sentences, and words in three minutes) are difficult 
for hoboes of chronological ages between 25 and 40, and that 
test 19 (definition of abstract terms) is easy for them. Fur- 
thermore, if we compare these cases with those for Williams' 
juvenile delinquents,® ages mostly 14 to 21, we find that the 
hoboes do much better than the delinquents in test 19 (defini- 
tion of abstract terms), and that the delinquents far excel 
the hoboes in tests 13, 16, and 18 (words in three minutes, 
drawings from memory, and dissected sentences). The same 
tendency holds true if we compare them with still younger 
cases. The only comparison possible between the business 
men and the High School pupils' is on tests 18 and 19 (dis- 
sected sentences and definition of abstract terms). Test 19 
is passed by 1 per cent more pupils than business men, but 
in test 18 this percentage rises to 10, showing that test 18, at 
least, is harder for business men. That is to say, the falling 
oflF in ability to put together dissected sentences has begun 
already in middle aged business men. In the comparison of 
abstract terms (a Stanford test which is similar to the Point 
Scale definition of abstract terms) 13 per cent more business 
men pass than do pupils. We find again then that younger 

7 The above seems to the writers a strong argument for the use of 
scales of the type of the Point Scale in all cases where there is a prob- 
ability of wide "scatter." In year scales there is far greater chance of 
passing over some defect or peculiarity simply because it is not expected 
at the chronological or mental age of the subject. 

• Terman and others, op, cit, p. 170 ff. 

•op, cit p. 171 ff. 
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persons consistently excel older in certain tests and are inferior 
to them in others. 

The results of other investigators, therefore, although ob- 
tained for quite different purposes, agree almost absolutely 
with our findings as to the influence of chronological age. 

Probable Reasons for the Differences Between Older and 
Younger Persons 

The above data show with reasonable certainty that there 
are decided changes in the distribution of abilities (as shown 
by the Point Sade) as persons get older. These changes 
appear whether we compare the insane or the normal, whether 
we lump all our cases together or fractionate them by par- 
ticular disease, whether we compare the verjr old with the 
very young, or whether we compare the middle-aged with 
young adults. The only condition which must be observed 
is this one : that only those whose total score, or general level 
of intelligence, is approximately the same may be reliablv 
compared. If we do not make this restriction, the young will 
be found to excel in each test as well as in the total score. 

The next question is: Why do we find this change in 
ability as persons get older? It is evident, of course, that 
as a person grows older he loses some of the abilities he had 
as a child or young adult. We are all familiar with aged per- 
sons who fail to remember what happened yesterday, but who 
expect their grandchildren to recall, as they themselves do, 
events which happened many years ago. We say commonly 
that old people have poor recent, but good remote memory, 
but we seldom inquire into their abilities outside the field 
of memory. 

In the present paper we have tried to determine more ex- 
actly the abilities and disabilities of the old and to estimate 
roughly, at least, the age at which changes are most marked. 
It is to be supposed that a defect in memory which is clearly 
present in a person of 80 must have been coming on for 
some time. 

We have found that in the abilities which are tested in the 
Point Scale the old persons have deteriorated much more in 
some than in others. The reasons for the individual losses 
we conceive to be three. In the first place, there is some 
actual loss in ability. This is shown particularly in the draw- 
ings from memory. From our practical acquaintance with 
aged persons we are forced to conclude that they are actually 
unable to recall certain recent impressions. In the second 
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place, there is a lack of practice in certain kinds of per> 
formance. Such, for example, we take to be the case in the 
construction of sentences. There seems to be a possibility 
that, given sufficient incentive and sufficient practice in this 
test, an older person may equal the performance of his juniors. 
The difficulty is that the common incentives such as praise, 
approval, etc., which are so effective with children, are of 
litUe avail with the old. We come now upon the third point 
which is probably the key of the whole problem. The yotmger 
subjects are almost invariably more alert and interested. Their 
experience is such that they fit more naturally into the test 
situation. They appear more adaptable than the older ones. 
Moreover, the tests in which they excel are those which most 
resemble " stunts " or " puzzles " and which, therefore, require 
not only willingness, but also a rapid adjustment of the sub- 
ject. If we consider the tests in which the older subjects are 
superior we find them to be the ones which are more like 
the problems which arise in the daily life of adults and which 
could be answered best by persons who had had the accumu- 
lated experience of years. 

There seems, therefore, to be such a decided break between 
the older and the younger persons that it is not fair by the 
former to grade them by an examination intended primarily 
for adolescents. The whole question of the applicability or 
fairness of any such examination to older subjects therefore 
depends on the purpose for which it is given. 

The purposes of examinations of persons over 50 seem to us 
to be two : first, the determination of the degree of deteriora- 
tion or aberration present; second, the determination of the 
presence of feeble-mindedness. In both cases there are two 
possible standards of comparison, namely their supposed 
former ability (or that of average normal young person) and 
the average ability of their contemporaries. It is without 
doubt interesting to note that a person who once had a mental 
age of 18 has now one of only 10. It is, however, of much 
greater importance to know whether the average person of 
the same present chronological age and of the same former 
mental age has deteriorated to the same degree. If the patient's 
deterioration is the same in amount and kind as that of his 
normal contemporary, then we cannot lay that deterioration 
to the presence of mental disease or to initial feeble-minded- 
ness. Moreover, if the history of an old person convinces 
us that he has always been of a low grade mentally it is 
often desirable to know the maximum mental age which the 
patient ever attained. Our best guess here would be based 
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on those tests in which the normal contemporary has not 
shown deterioration. 

In most work with psycholc^cal examinations we have the 
constant difficulty that many non-psychological persons (and, 
alas ! some psychologists) take our results as too simple. They 
read the mental age, without taking any notice of the com- 
ments of the examiner. If the mental age is less than 12 they 
glibly diagnose the patient feeble-minded. In order to cir- 
cumvent such hasty diagnosticians and in order to give a 
mental age which shall more exactly express the ability of the 
subject before the influences of old age became marked, we 
have calculated some allowances which should be made in the 
case of persons over 50 years of age. 

Suggested Score Corrections for Old Age 

Already at this hospital we had been in the habit of making 
allowance for the omission of certain tests and we now applied 
the same method to a scheme for discounting the effect of 
advancing years. Perhaps it will be as well to give the history 
of the previous work, so that the present calculations will 
not seem too fanciful. To be sure, the plan we are about to 
present has obvious faults and we can claim for it no more 
than fairly satisfactory results. We give it here in the 
hope that the idea will lead some others to similar work and 
will in the end result in an accurate and theoretically correct 
table. 

The first problem of the kind which arose was the question 
of how to grade patients who were totally deaf and who, 
therefore, could not be given tests 4 and 6 (auditory memory 
span for digits and sentences). Our procedure at first was 
to add the scores with these tests omitted, call that the mini- 
mum mental age, then add to that the highest score obtainable 
on the two omitted tests, call that the maximum mental age, 
and then say that the true mental age lay somewhere between 
those two limits. This was fairly satisfactory, but we thought 
it possible to get a more accurate statement. This we com- 
puted from our table of scores for each test which were to be 
expected for different ranges of total score.^® From the 
table we calculated the amount of credit to be expected on 
tests 4 and 6 for each of the ranges of total score. We then 
constructed a table giving the amount that should be added 
for each total score obtained when the two tests were omitted. 

^® This table was published with some printer's errors, (later cor- 
rected) in the Journal of Abnormal Psychology, XIII, 1918, p. 77. 
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We later made similar tables of corrections for omission of 
tests 14 and 18 (lack of education) and for tests 1, 2, 3(a), 
7, 11, 12, 16, and 18 (total blindness). The corrections for 
lack of education were adopted by the Division of Psychology 
in the Surgeon General's Office for use in the examination 
of illiterates. The corrections are given in Table 6. 

TABLE 6 

Corrections for Point Scale Norms When Certain Tests Are 

Omitted 

When 4 and 6 When 14 and 18 When 1, 2. 3 (a). 7. 11, 
are Omitted are Omitted 12, 16, and 18 

are Omitted 
(Deafness) (Education) (Total Blindness) 

For Scores: Add: For Scores: Add: For Scores: Add: 

13-25 5 18-51 7-13 11 

26-«) 6 52-58 2 14-15 15 

61-78 7 59-62 4 16-21 16 

79 8 63-69 6 22-28 17 

80-91 9 70-74 8 29-34 18 

75-77 9 35-39 21 

78-90 10 40-42 24 

43-48 27 

49-50 29 

51-52 30 

53 32 

54 33 

55-66 34 

With these tables as models, we proceeded to make a similar 
table to correct for advanced chronological age. We have 
found throughout, as we have said, that the older subjects are 
almost without exception poorer in tests 13, 14, 16, and 18 
than younger persons attaining the same total score. We have 
therefore supposed that these tests should be omitted in giving 
the examination to old people and have calculated the cor- 
rections for such omission. We do not mean that the tests 
should actually be omitted. On the contrary, if a person of 
over 50 years of age obtains a high score on the four tests, 
it is evident that he has not begun to lose certain abilities 
which many of his contemporaries have lost. In other words, 
in our opinion failure on tests 13, 14, 16, and 18 on the Point 
Scale means little or nothing if the subject is advanced in 
years, while success on those tests may be very significant. 
The corrections which we offer tentatively for this group of 
advanced ages are given in Table 7. 
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TABLE 7 
O»RBcn0NS FOR Point Scale Norms TO BE Used With Oldbr Subjects 

When Tests 13, 14, 16 and 18 are 
Omitted 
(Advanced Chronological Age) 

For Scores: Add: 

18-36 

37-43 1 

44-48 3 

4^-53 5 

54-55 9 

5&-58 12 

59-61 13 

62-66 15 

67-69 17 

70-82 18 

At first thought it may appear that if we correct for failures 
which seem to be due to advanced age alone, we should also 
correct for successes which are apparently due to the same 
cause. Perhaps we should. If the idea were carried to its 
logical extreme we would be correcting for every test except 
1 and 20, the only ones in which the average score for young 
and old is identical. Such a procedure would, of course, be 
meaningless, and would amount to giving a mental age on 
the basis of two tests alone. Somewhere, then, we must draw 
the line between no correction and total correction. We con- 
sidered at first correcting for those tests in which one age 
gave an average score which was 120 per cent of the score 
obtained by the other age. This limit, however, would make 
us correct for 8 tests, in five of which the younger and in 
three of which the older were superior. Eight seemed such 
a large percentage of the total number (20) of tests that we 
were afraid we were again basing mental age on too few 
tests. If the limit were raised to 200 per cent, we would 
be correcting for only three tests, 13, 14, and 16. Test 18 
which came next on the list with the younger excelling the 
older by 136 per cent, was later included because the test is 
one which many of the older subjects dislike, and which they 
often cannot see to read. The actual limit used was, there- 
fore, 136 per cent. 

Conclusions 

1. There are certain definite changes in the distribution of 
scores on the Point Scale as the chronological age of the sub- 
ject increases. 



Digitized by 



Google 



58 FOSTER AND TAYLOR 

2. These changes are evident in both normal and psychotic 
persons. 

3. There are three probable reasons for the changes: loss 
of ability, lack of practice, and absence of alertness or of 
interest in the older subjects. 

4. The mental condition of a subject over 50 years of age 
will be much more accurately presented if two mental ages 
are given: one which compares him with his own adolescent 
ability (or with that of normal young persons), and one which 
compares him with his normal contemporaries. 

5. A mental age which compares a subject with his normal 
contemporaries may be calculated from our Table 7. 
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SOME RESULTS AND INFERENCES DERIVED FROM 

THE USE OF THE ARMY TESTS AT THE 

UNIVERSITY OF MINNESOTA^ 



By M. J. Van Wagenen, University of Minnesota 



During the two academic years 1917-18 and 1918-19 the 
Army Test Alpha or its equivalent, Form E, was given to the 
freshman classes of nearly all the colleges at the University 
of Minnesota. In some of the colleges the results were used 
as an aid in diagnosing the causes of student failures. In 
other colleges the purpose was purely an experimental one. 
The use of the tests has revealed some significant information 
regarding the students of the various colleges. For instance, 
over eighty per cent of the student body of the University as 
a whole were found to come from the upper fifteen to twenty 
per cent of the population in general. With the exception 
of two of the individual tests the women of the several col- 
leges did just as well or even better than the men of the 
same colleges, but in these two tests — the range of informa- 
tion test and the arithmetic problems test — from seventy to 
seventy-five per cent of the men did as well or better than 
the median woman. Making correction for the excess of over- 
lapping due to the use of a single test, from sixty-five to 
seventy per cent of the men may be expected to do as well or 
better in solving arithmetic problems and to have as wide or 
a wider range of the kind of information called for in the 
Army Tests than has the median woman of the same college. 
Incidentally, the students of the College of Education were 
found to be a markedly superior group, — corresponding well 
with the highly selected group in the Medical School, — a fact 
which speaks well for the leadership of the teaching pro- 
fession. More surprising was the discovery that eighty per 
cent of the students of one technical college fell below the 
median student of another technical college in the abilities 
involved in the doing of such tasks as those making up the 
Army Test. And this is evidently a stable condition, for the 

^Read before Section L of the American Association for the Ad- 
vancement of Science at the Annual Meeting, held in St. Louis, De- 
cember, 1919. 
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differences of the second year were practically the same as 
they were for the first year the test was given. 

Interesting and valuable as such information may be to 
those in charge of the various colleges, nevertheless we are 
more concerned at the present time with the actual value of 
the Army Test and similar mental tests as a basis for predict- 
ing what kind of academic work will be done by each student 
during his college course, and especially with the further use 
that may be made of such tests as a basis of acquiring more 
definite knowledge of vocational aptitudes than merely the 
settling of the question as to whether or not a student is 
likely to succeed in completing a college course. 

During 1918-19 one of the graduate students in the depart- 
ment of educational psychology, Miss Judith Jacobs, worked 
out the correlations of the scores of the Army Test and also 
the correlations of the scores of each of the individual tests 
with the averages of the marks made by the women students 
of the College of Science, Literature and the Arts during 
each semester of their freshman year. The second Army 
Test given to the University freshmen was also given to a 
large number of sophomore women, most of whom had taken 
a similar test, Form E, the previous year. This made pos- 
sible a comparison of the students' scores on the two tests 
taken some fourteen months apart and also the determina- 
tion of the relation of each of the two Army Tests used to 
the averages of the academic marks made by the women during 
each semester of their freshman year. It was necessary to 
confine this study to the records of the women students of 
the College of Science, Literature and the Arts, as no other 
college offered so large a group of records for the women 
and the work of the men had been too badly broken up with 
the advent of the S. A. T. C. to permit of any accurate study 
being carried on with the use of their academic marks. 

For 139 women students between the ages of eighteen and 
twenty. Miss Jacobs found a correlation of -}-'39±.0S between 
the scores made in the Army Test, Form E, and the averages 
of the marks for the first semester of the freshman year, a 
correlation of -f-.35 ±05 with the averages of the marks for 
the second semester, and a correlation of +-34 ±.05 between 
the scores made in the Army Test Alpha, Form 6, and the 
averages of the marks for the first semester of the previous 
(freshman) year. Miss Jacobs also found that the correla- 
tion between the averages of the marks for the first semester 
of the freshman year and those of the second semester was 
+.78 ±.02, while the correlation between the Army Test, Form 
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E, and Alpha, Form 6, was +82 ±.02. The correlation be- 
tween the scores of the Army Test, Form E, and the averages 
of the marks for the first quarter of the sophomore year 
dropped to +.13 ±.05. At the same time the correlations 
between the averages of the marks for the first and second 
semesters of the freshman year and the averages of the marks 
for the first quarter of the sophomore year fell to +.51 ±.05 
and +.52 ±.05 respectively. The very low correlation between 
the Army Test scores and the averages of the students' marks 
for the first quarter of the sophomore year is undoubtedly 
due to a very large extent to the errors of judgment in the 
assignment of the sophomore marks, since the quarter involved 
less than ten weeks of academic work. If this assumption 
is true then any increase in the accuracy of the judgments 
of the instructors regarding the quality of students' achieve- 
ments should result in higher correlations between the Army 
Test scores and the averages of the academic marks. Later 
it will be shown that this was exactly the condition found. 

For the individual tests of the Army Test the averages of 
six correlations of the scores with the averages of the marks 
of one semester are as follows : 

Practical judgment scores andaveragesofmarksfor 1 semester r = — .09 

Oral Direction scores - - - - -- « r— -.01 

Scries completion scores - « - « « - « r«+.15 

Disarranged sentences scores • * * « n « « r«=-|-.21 

Anak)gie8 scores - - - - - - - r«+.25 

Synonsnn-antonym scores * * * « « « « r==-}-.27 

Range of information scores * * * « « « u j_^3j 

Anfimetk problems' scores « - - « - - - r=+.36 

The scores of two of the eight individual tests show practically 
no relationship to averages of the marks, while the scores of 
five show a correlation above +.20, the scores of two of them 
— ^the range of information test and the arithmetic problems 
test — ^showing a correlation above +.30. 

The relationships between the scores of the two Army 
Tests, those between the averages of the marks for the two 
semesters of the freshman year, and those between the scores 
of the Army Tests and the averages of the marks for each 
semester are shown in the following table more clearly per- 
haps than they are expressed by the coefficients of correlation. 
By first finding the standard deviation or sigma for the scores 
of the Army Tests and for the averages of the marks, and 
then finding in which of the ten one-half sigma units each 
individual score fell, we have the table below. It reads: Of 
the 141 students who took both Army Tests, 39 per cent 
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stood in the same one-half sigma unit or differed in their 
standing in the two tests by less than one-tenth of the range 
of the scores of the college students; 41.9 per cent differed 
by not more than one one-half sigma unit or by less than 
one-fifth of the range of the scores; 15.6 per cent differed 
by not more than two one-half sigma units or by less than 
three-tenths of the range of the scores; 2.8 per cent differed 
by not more than three one-half sigma units or by less than 
four-tenths of the range of the scores; while only 0.7 per 
cent differed by as much as four one-half sigma units. 

TABLE I 

Amount of Tests form Awracesof Form B ind Form E ind Form 6 and Form 6 and 
Difference E and Form Grades of Averasesof Averafes of Awraces of Averafss of 
in one-balf 6 1st Semes- Grades of Grades of Grades of Grades of 

Sigma Units ter and of 1st Semes- 2nd Semes- 1st Semes- 2nd Semea* 

2nd Seme- ster ster ster ster 

No. of Cases 141 224 241 235 105 105 

Difference 39.0% 34.4%. 

1 " 41.9% 37.5f 

2 '• 15.6% 18.7? 

3 " 2Jl% 7.15 

4 " 0.7% 0.44 

5 " 0.94 

6 " 0.9^ 

Although two of the individual tests of the Army Test 
contribute practically nothing and a third but little toward 
prognosticating the academic record of a student, it is never- 
theless astonishing how much the Army Test, taking less than 
forty-five minutes to give, will tell about a student's probable 
success in making academic marks during either semester of 
the freshman year. Over fifty per cent of the students will 
not change their standing in academic marks from their 
standing in the Army Test by more than one one-half sigma 
unit or by more than one-fifth of the range of the scores 
of college students or by more than a change from a D to 
a C or from a C to a B, as these marks are given to college 
students. Over twenty-five per cent of the students will make 
a greater change in their standing in their academic marks 
from the first semester to the second, even when the same 
subjects are studied and, for the most part, with the same 
instructors. As far as making academic marks m either 
semester of the freshman year is concerned less than fifteen 
per cent of the students will be misplaced by the Army Test 
by more than three one-half sigma units or by four-tenths 
of the range of the marks or by as much as a change from 
an E to a C, or from a D to a B, or from a C to an A. True 
it is that this is a rather large misplacement, but over two 
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per cent of the students are displaced just as much in their 
academic marks from the first semester of their freshman 
year to the second semester. Then, too, were the academic 
marks of both semesters of the freshman year taken into 
account the amount of misplacement by the Army Test would 
be considerably less than here indicated. 

Equally significant with the determination of the amount of 
change that occurs in connection with the Army Tests and 
college marks is the determination of the direction of the 
changes that may be expected of students of different degrees 
of ability. For this study three groups of students were 
selected: those who stood in the second and third one-half 
sigma units or in the E and D — units, those who stood in 
the fifth and sixth one-hsdf sigma units or in the C — and C 
units, and those who stood in the ei^th and ninth one-half 
sigma units or in the B and A — units. The units referred 
to are the one-half sigma units or the respective tenths of the 
base line of a normal surface of frequency l3ring between 
— 2.5 sigma and -f~2.5 sigma. 

The first table below (Table II) and subsequent tables 
(Tables III to VII) read: Of the 23 students who stood 
in the second and third one-half sigma units from the bottom 
of the distribution or in the E and D— group in the first Army 
Test, 34.8 per cent did not change their position in the second 
Army Test as much as one one-half sigma unit or as much 
as the difference between an E and a D — ; 39.1 per cent 
changed as much as one one-half sigma unit but not as much 
as two one-half sigma units or not as much as the difference 
between an E and a D; 21.7 per cent changed as much as 
two one-half sigma units but not as much as three one-half 
sigma tmits ; while only 4.4 per cent changed as much as four 
one-half sigma units or as much as from an E to a C. While 
34.8 per cent of the group did not shift as much as one 
one-half si|;ma unit in either direction, 52.2 per cent made a 
higher position in the second test than in the first one and 
13 per cent made a lower position in the second test. Of the 
group of fifty-seven C— and C students 36.8 per cent remained 
practically stationary in the second Army Test, while 24.5 
per cent made a higher position and 38.6 per cent made a 
lower position. Of the l5 B and A — students 53.3 per cent 
remained in the same positions, 26.7 per cent attained a higher 
position and 20 per cent dropped to a lower position. 
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TABLE II 

Amounts op Changb op Position Prom Army Tbst, Porm B, to Army Tbst Alpha. 
PoRM 6, IN THB Case op Thrbb Groups op Students 

Amount of Difference in 2nd and 3rd one- 5th and 6th one- 8th and 9th one- 
One-half Sigma Units half Sigma Units or half Sigma Units or half Sigma Units or 
the E and D— Group the C— «nd C Group the B and A — Group 
of Students of Students of Students 

No. of Caaet 23 57 15 

©Difference 34.8% 36.8% 53.3% 

1 •• 39. 1% 45.6% 33.5% 

2 •• 21.7% 15.8% 6.6% 

3 •• 1.7% 6.6% 

4 •! 4.4% 

Per Cent of Cases Falling 

in Higher Units in 2nd 

Test 52.2% 24.5% 26.7% 

Per Cent of Cases Palling 
in Lower Units in 2nd 

Test 13.0% 38.6% 20.0% 

The table (Table III) giving similar facts for the averages 
of the academic marks of the two semesters of the freshman 
year shows the same tendencies ; namely, the smallest amount 
of shifting occurs among the superior students and it is just 
as likely to be a shift to a higher as to a lower position. The 
greatest amount of shifting occurs among the students making 
the lower records and is more likely to be a shift upward than 
a shift downward. The dominant shifting tendency among 
the students of the middle group is a downward one in the 
second semester's work as well as in the second Army Test. 

TABLE III 

Amounts op Change op Position Prom Marks of tub Pirst Sbmbstbr to thb Marks 
op thb Sbcond Sbmbstsr in thb Cask op Thrkb Groups op Studbnts 

Amount of Difference in 2nd and 3rd one> 5th and 6tb one- 8th and 9th one- 

one-half Stigma Units half Sinna Units half Sigma Units half* Sigma^ Units 

or the E and D— or the O— and C or the B and A— 

Group of Students Group of Students Group of Students 



No. of Cases 

Difference 15.4% 

1 •• 46.2^ 

2 " 23.1 

3 •• 12.8' 



\ " :::::::::v.;;;;;;;;;;;.^^::v;;;;;;;;;^''*:::::::v;.."-4:5% 

Per Cent of Cases Falling 
in Higher Units in 2nd 

Semester 53.8% 22.6% 31.8% 

Per Cent of Cases Falling 
in Lower Units in 2nd 

Semester 30.8% 38.1% 31.8% 

The next four tables (Tables IV to VII) indicate in the 
same way the degree of stability and the amount and direc- 
tion of the shifting of positions from those achieved in the 
Army Tests to those made in the academic grades. 
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TABLE IV 

Amounts or Changs of Position Fkom thb Aiuit Tbst, Form E. to thb Makks of 
THE First Sbmbstbr op thb FRbshman Year 



AxDount of Difference in 2nd and 3rd one- Sth and 6tb one- 
one-half Sigma Unite half Sintia Unite half Sigma Unite 
or the E and D— or the C— and C 
Group of Stodente Group of Stndente 



Sth and 9th one- 
half Sinna Units 
or the B and A— 
Group of Studente 



NoofCaaes 48 

Difference 29.2% 

1 •• 22.9% 

2 " 8.3% 

3 •• 14.6% 

4 •• 16.7% 

5 •• 8.3% 

Per Cent of Cases Falling 

in Higher Unite in First 

Semester's Marks 60.4% 35.7% 6.7% 

P^ Cent of Cases Falling 
in Lower Unite in Ist 

Semester's Marks 10.4% 45.2% 80.0% 

TABLE V 

Amounts op Changs op Position From ths Army Tbst. Form E, to ths Marks op 
THs Second Ssmsstbr op thb Frbshman Ysar 



Amount of Difference in 
one-half Sigma Unite 



2nd and 3d one- Sth and 6th one Sth and 9th one 

half Sifma Unite half Sinna Unite half Sigma Unite 

or the £ and D— or the C— and C or the B and A— 

Group of Studente Group of Studente Group of Students 



No. of 

Difference 12.8^ 

1 
2 
3 
4 
5 
6 



P^ Cent of Cases Falling 
in Higher Unite in 2nd 

Semester's Marks 

Per Cent of Cases Falling 

in Lower Unite in 2nd 

Semester's Marks 



.68.1% 34.1%. 



.10.7% 



.19.1% 45.1% 82.1% 



TABLE VI 

Amounts op Changs op Position From thb Army Tbst Alpha, Form 6, to thb 
Marks op thb First Sbmbstbr op thb Frbshman Ysar 



Amount of Difference in 
one-half Sigma Unite 



No. of Cases. 



2nd and 3rd one- 
half Sigma Unite 
or the E and D^- 
Group of Studente 

14 



Sth and 6th one- 
half Sigma Unite 
or the C— and C 
Group of Studente 

35 



8th and 9th one- 
half Sigma Unite 
or the 6 and A— 
Group of Studente 



Difference 21.4< 

1 " 21.4- 

2 •• 16.4" 

3 •• 21.4< 

4 •• 21.4< 

5 " 

6 " 

P^ Cent of Cases Falling 

in Higher Unite in Ist 

Semester's Marks 

P^ Cent of Cases Falling 
in Lower Unite in 1st 

Semester's Marks 7.1%. 



71.4% 45.7%. 



5.0% 



0.0% 



.40.0% 80.0% 
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TABLE VII 

Amounts op Chanck op Position Prom thb Army Tssts Alpha Form S, to thb 
Marks op thb Sboond Sbmbstbr op thb Frbshman Ybar 

Amount of Difference in 2iid and 3rd one- 5th and 6th one- 8th and 9th one- 
one-half Sigma Units half ^nna Units half SJcma Units half Sicma Units 
or the £ and D— or the O— and C or the B and A^ 
Group of StudenU Group of Students Group of StudenU 



No. of Cases. 

Difference. . 

1 

2 

3 

4 

6 - .. 



Per Cent of Cases Falling 
in Higher Units in 2nd 

Semester's Marks 78.6% 36.1% 21.1% 

Per Cent of Cases Palling 
in Lower Units in 2nd 

Semester's Marks 15.4% 36.1% 78.9% 

The facts of these tables may be briefly and conveniently 
summarized as follows : the per cents of students making low 
scores in the Army Tests who stay in the same positions 
in their academic marks are relatively low, ranging from 7 
per cent to 29 per cent in the four tables. The per cents of 
low standing students making lower positions in academic 
marks than in the Army Tests are also small, ranging from 
7 per cent to 19 per cent ; while the per cents making higher 
positions in academic marks than in the Army Tests are 
relatively high, ranging from 60 per cent to 78 per cent. In 
the case of the middle group of students — the C — and C stu- 
dents — from 35 per cent to 45 per cent are likely to achieve 
a higher position in academic grades than in the Army Tests. 
Likewise from 35 per cent to 45 per cent are likely to fall 
to a lower position in the academic grades than in the Army 
Tests. The amount of shifting in this group is smaller, how- 
ever, than in either the superior or the low standing group of 
students. Not more than from 15 per cent to 30 per cent of 
the average students shift their positions in academic marks 
from those made in the Army Tests by more than the differ- 
ence between a D and a C or that between a C and a B. In 
the case of the superior students just the opposite tendency 
is found from that found among the students making the 
lower records in the Army Tests. Practically 80 per cent 
of those making the higher positions in the Army Tests make 
somewhat lower positions in their academic grades, while only 
from to 20 per cent achieve higher positions in their academic 
marks than in the Army Tests. 
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This situation is highly significant in dealing with the use 
of mental tests for prognosticating a student's probable 
academic success. It would seem that the tests prove least 
useful just where reliable results from their use is most 
needed ; namely, in eliminating those most likely to fail in their 
college work and in selecting for special groups those who 
are most likely to attain the higher degrees of success. When 
it is recalled that of those standing low in the Army Test 
far more of them are likely to reach only slightly hi^er 
positions in their academic work it is not improbable that 
the extra amount of effort put into their work by the very 
low standing students may account in part for the large per- 
centage tending to attain higher positions in their academic 
work. Likewise the fact that the students standing in the 
higher positions in the tests tend to fall in somewhat lower 
positions in their academic work may in part be accounted 
for by a lack of maximum application to their work, espe- 
cially when there is not the external pressure to keep them 
working at their maximum effort that is exerted upon the less 
capable students. In addition to these factors some amount of 
shifting is undoubtedly to be accounted for by the large amount 
of outside work done by not a few of the students, and also 
by the insistent demand of the more serious social activities 
upon the time and effort of the more socially inclined indi- 
viduab. It is not improbable, too, that it is particularly diffi- 
cult for the instructors to select the exceptionally gifted 
college students and to accurately gauge their abilities and 
their achievements, just as for the elementary school teacher 
to select the exceptionally gifted pupils of her class has been 
found to be attended with great inaccuracy. 

There is yet, however, far too large a discrepancy between 
the positions attained in the Army Tests and those achieved 
in academic marks to warrant the use of the Army Tests for 
purposes of rigid selection. Two questions insistently arise 
at this point : First, are mental tests, such as the Army Tests, 
improvable to the degree that their use will be feasible in 
selecting and classifying college students? To this question 
an affirmative answer is undoubtedly warranted at the present 
time. Second, is it possible to improve the tests to the point 
of reducing the discrepancies within reasonable limits without 
at the same time securing more adequate measurements of 
the actual achievements of college students than is now afforded 
by the academic marks, which are based very largely upon the 
subjective judgments of the instructors? An affirmative 
answer to this question is reasonably doubtful, and this, too. 
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is one of the more important conditions tending to minimize 
the actual value of the use of mental tests in connection with 
the admission and classification of college students. 

Mental tests such as the Army Test are improvable for the 
end in view in two directions: first, additional tests showing 
a fair degree of correlation with academic marks and at the 
same time contributing elements not found in the tests already 
available may be included with those now showing some degree 
of relationship to academic marks; second, the reliability of 
the tests may be increased by improving the tests and by 
making them more extensive so that similar series of tests 
will give more nearly the same arrangements of scores for the 
individuals tested. The fact that nineteen per cent of the 
subjects tested by the two Army Tests showed a change of 
one-fifth or more of the total range of the scores for college 
students is very clear evidence of the need of more extensive 
tests — ^tests lasting a few hours instead of a few minutes. 
This is not a criticism of the Army Test for the purpose for 
which it was intended. To classify the upper twenty per 
cent of the population in small units is a much more difficult 
task than to classify the total population into relatively large 
units. Incidentally, one of the strangest phenomena in con- 
nection with the use of mental tests has been the demand 
of so many intelligent people in the field of education that 
the tests accomplish in a very few minutes what they them- 
selves willingly admit cannot be as well accomplished by any 
other means in any length of time. 

Just as increasing the length of the tests, other conditions 
being equal, increases the reliability of the tests, so increasing 
the number of judgments regarding the academic work of the 
students ought, other conditions being equal, to increase the 
reliability of the marks, and, at the same time, enhance the 
relationship between the tests and the academic marks if 
errors of judgment regarding academic achievements are in 
part responsible for the relatively low correlations between 
the test scores and the averages of the academic marks. In 
the case of eighty-four sophomore women for whom complete 
records were available the following coefficients of corre- 
lation were obtained when the scores made in the two Army 
Tests, Form E and Alpha Form 6, were correlated with the 
averages of the academic marks for both the first and the 
second semesters. 

Army Test, Form E and averages of marks for the two 
semesters r=+.46±.06. 
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Army Test Alpha, Form 6 and averages of marks for the 
two semesters r==-f-.50. 

For the five individual tests of the Army Tests that gave 
the highest correlations with the averages of the marks, the 
following average correlations were obtained with the averages 
of the marks for both semesters: 

Di8an:anged sentences scores and av. of marks for both semesters rs* +^ 
Synonym- Antonym scores « « « u u u u r_, ^^ 

Itange of Information saxes « « « u u u « r^-^^g 

Aiu£)gies scores « « « u u u a ^^^^ 

Arithmetic problems 'scores « « « « « « « r=--|-.4I 

When the scores for these five tests were combined and the 
correlations between the two combinations and the avera|^es 
of the marks for the two seitiesters obtained the foUowmg 
coefficients were found : 

Five tests of Form E and averages of marks for both semesters r =« +.44 
Five tests of Alpha Form 6 and av. of marks for both semesters r = +.47 

From these results two facts are evident: the correlations 
between the Army Test scores and the academic marks were 
very noticeably raised — ^approximately one-tenth — when the 
number of academic marks used was doubled. The inclusion 
of the three individual tests showing the lower correlations 
raised the correlations for the group of tests but very little. 
The importance of the first fact is not to be overlooked, for 
it urgently suggests that the low correlations found between 
the Army Test scores and the averages of the marks for 
either semester of the freshman year, and especially the 
averages of the marks for the first quarter of the sophomore 
year, were in no small measure due to errors of judgment in 
the estimations of the achievements of students. Further- 
more, when the scores of the two Army Tests were combined 
the correlations between the combined scores and the averages 
of the marks for the two semesters was +.47. Also when 
the scores of the ten selected tests of the two Army Tests 
were combined into a single score, the correlation with ttie 
averages of the marks for the two semesters was likewise 
+.47. Thus it is clear that to obtain high correlations between 
the scores made in mental tests and averages of academic 
marks, it is essential to have more accurate measures of the 
academic achievements of students than the subjective esti- 
mates of the instructors. This of course does not imply 
that it is either unnecessary or not worth while to increase the 
reliability and the scope of the tests. It does suggest, how- 
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ever, that because of the inaccuracies of college marks as meas- 
ures of academic achievements it will not be feasible to ac- 
curately determine the full prognostic value of the tests. 

That academic marks are not at all accurate indices of 
achievement or of abilities acquired is not a sheer guess nor 
even just a matter of opinion. The composition ability of 
some ninety-eight sophomore students was measured by hav- 
ing them write two half -hour themes and then having the 
themes rated for general merit by three college instructors of 
English with the use of the Thomdike Extension of the Hille- 
gas Scale for Measuring English G)mposition. The correla- 
tions between the rhetoric marks of the freshman year and 
the quality of the themes were as follows: 

First semester rhetoric marks and qualities of compositkm A r=s+-45 

First semester rhetoric marks « « « « B r= +.42 

Second semester rhetoric marks « « « « A r=* +.41 

Second semester rhetoric marks *" « « « B r=:»+.39 

The correlation between the rhetoric grades for the two 
semesters was -{-.68, while that between flie two themes was 
-|-.49. Making corrections for attenuation, the correlation 
between the ability to make marks in freshman rhetoric and 
the ability to write English compositions was only +-72- This 
is only one measurement of the relationship in question and 
hence is not to be taken too seriously. There is no reason 
to suppose that rhetoric marks are less accurate than the marks 
in other college subjects. With no higher correlation, how- 
ever, than -|-./2 between the ability to make academic marks 
and the ability to achieve results, one cannot expect very 
high correlations between scores in mental tests and academic 
marks, even though the tests have a high value for prc^osti- 
cating probable academic achievement. This condition of 
course places upon the psychologist working to derive more 
adequate mental tests for college use an additional feature 
of uncertainty to cope with. 

The most important finding in cotmection with the use of 
the Army Tests at the University of Minnesota, however, was 
the revelation of distinct group diflFerences among the several 
college student bodies. In four of the college groups to which 
the tests were given in the two successive years the personnel 
of the groups probably changed but little from the one year 
to the next. A comparison of the median achievements of 
these groups afforded some suggestive results. In comparing 
the positions of the medians of the eight individual tests 
of the two Army Tests in the case of the men and the women 
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in the College of Science, Literature and the Arts the median 
men stood higher than the median women in five of the tests 
of Form E. They also stood higher in four out of the five 
corresponding tests of Form 6. In three of the tests of 
Form E the median men stood lower. In each of the three 
corresponding tests of Form 6 they also stood lower. Upon 
making a similar comparison in the case of the men in the 
College of Science, Literature and the Arts and the men in 
the College of Engineering, the median men in the College 
of Engineering stood higher in five of the tests of Form E. 
In four of the five corresponding tests of Form 6 they also 
stood higher. At the same time the median men in the Col- 
lege of Engineering stood lower in the other three tests. In 
two of the three corresponding tests of Form 6 they also 
stood lower. This lends support to the presumption that there 
is probably a much closer correspondence between the relative 
sizes of the medians of two corresponding groups of individ- 
uals in two similar tests than between the relative sizes of the 
medians for two different groups in the same or similar series 
of tests. Assuming this to hold true for the large group of 
male students in the College of Science, Literature, and the 
Arts, the medians of this group were taken as standards in 
all the tests and the per cent of each of several groups doing 
as well as or better than this standard was determined for 
each test in the two groups of tests, Form E and Form 6. 
In so far as the assumption does not hold true, obviously, the 
effect would be to lower the correspondence where the corre- 
sponding groups took two different series of similar tests. 
After the per cents of overlapping for each test for each 
of the available groups — the College of Engineering students 
and the College of Dentistry students — had been ascertained, 
the tests in each group of tests were arranged for each college 
group according to the amounts of overlapping. When the 
correlations were then determined between the various arrange- 
ments it was found that the coefficients for each two different 
college groups, derived by Pearson's shorter method, were 
-I-.07, —.04, +.39, and —.10 respectively, but that when the 
relationships between the two arrangements for the two sets 
of tests for the corresponding groups of the same college were 
determined the coefficients were +.71 for corresponding groups 
of one college and +.68 for the corresponding groups of the 
other college. This means that the second freshman class 
tc^sted in the College of Engineering stood high in the same 
tests as did the first freshman class, also low in the same 
tests as did the first freshman class tested. The same con- 
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dition was found to hold true for the two freshman classes 
tested in the Coll^;e of Dentistry. On the other hand, the 
freshman classes in the College of Dentistry did not stand 
highest in those tests in which the freshman classes of the 
G)llege of Engineering did, nor did thev stand lowest in those 
tests in which the freshman classes of the College of Engi- 
neering stood lowest. In fact, there was practically no simi- 
larity or relationship evident when the freshman classes of 
the different collies were compared with one another as is 
shown by the average of the four correlations above ; namely, 
r=-f.08±.05. 

These indications strongly suggest that in so far as students' 
interests tend on the whole to lead them to seek the occupa- 
tions for which they are the better fitted by nature, mental 
tests may in time be used not only as a means of predicting 
a student's probable chances of success in college work in 
general but also as a basis of predicting his chances of success 
in doing the work of each of die various technical colleges and 
at the same time as a basis for giving the student more 
accurate advice in the matter of selecting a vocation than can 
now be given. This task will be long and arduous, and one 
demanding the fullest degree of co-operation on the part of 
education^ leaders, especially those in the universities, but 
the results will surely repay for the efforts many-fold. 
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PROPHESYING ARMY PROMOTION 



By S. C KoHS, Psychologist to G>urt of Domestic Relations, Portland, 
Oregon, and K. W. Irlb, Reed College, Portland, Oregon 



The htunan mind has manifested from time immemorial 
an insatiate hunger for those phenomena and traits which 
could answer the question, no matter how indirectly and in- 
adequately, "What may I expect on the morrow, — next 
month, — next year?" Our star-gazers, palm-readers and our 
bump-feelers are still with us in spite of persistent efforts 
on the part of scientific criticism to discredit them, and the 
intense eagerness to know that which the future may hold in 
store for us has increased in the last few decades to immeasur- 
able proportions. 

It is not surprising that many have turned with hope toward 
psychology as the analyzer of individuality, of traits, of cus- 
toms, of events ; toward psychology as a synthesizer of more 
or less fragmentary mental evidence for the purpose of more 
clearly indicating or prognosticating what one might expect 
in the future, granting that a given set of causes would in- 
evitably be active. 

This tendency toward developing a prophetic procedure is 
taking more concrete and definite form in connection with 
intelligence testing than with any other phase of experimental 
psychology. Thus we note one study on "The Relation of 
Mental Testing to School Administration, with Special Ref- 
erence to Children Entering School,"* in which one of the 
objects was " to offer predictions as to the probable advance- 
ment of each child through the primary grades, — this prediction 
being based primarily on the potential mental capacity as shown 
by the Binet mental test." (p. 4). A similar study is now 
under way at Stanford University by W. M. Proctor, dealing 
with the prediction of progress of students through the sec- 
ondary school. Terman's book "The Intelligence of School 

1 By Virgil E. Dickson, in Normal Seminar Bulletin A, No. 1, July, 
1917, Dept. of Educ. State Normal School, Cheney, Wash. Sec also 
L. M. Terman: The Intelligence of School Children, Houghton Mif- 
flin. 1919. 
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Children" is a splendid contribution to this general subject. 
The results of these investigations lead one to a very optimistic 
outlook regarding the possibilities of prophesying school pro- 
gress. The psydhological work in the army was largely con- 
cerned with predicting whether a raw recruit showed promise 
of being an asset or a liability to the army organization, and 
if an asset whether as a leader or a follower. In its pamphlet' 
the Psychological Division of the Army presents ample proof 
that the Army Intelligence Tests have been an efficient prophe- 
sying agency. And, finally, Terman is accumulating data 
which seem to point toward a constancy of relationship between 
life age and mental age, which if it is proven to exist will 
materially assist the prophecy of success or failure of an 
individual in various lines of activity. The increase of 
interest and research in trade tests and special aptitude tests 
will add data of inestimable value making for greater efficiency 
in selecting promising material for special lines of endeavor. 
The present study is an attempt to determine to what extent 
Reed College could have predicted the progress of 116 of its 
students who entered the service of the army or the navy. 
The data upon which such predictions might have been based 
would have been (a) the quality of their college work, and 
(b) faculty estimates regarding (1) their physical qusdities, 
(2) their intelligence, (3) their leadership, (4) their personal 
qualities, and (5) their general value to the service. 

The Original Data 

The material for investigation came from three distinct 
sources. 

Source A. RATINGS. Three judges, members of the 
Reed faculty, rated each of the 116 students by means of 
Scott's Rating Scale." Information was thus obtained regarding 
the faculty's estimate of each of these men on physical quali- 
ties (3 points the lowest, to 15 points highest), intelligence 
(3 to 15), leadership (3 to 15), personal qualities (3 to 15), 
and general value to the service (8 points the lowest, to 40 
points the highest). 

Source B. MARKS. The college marks were obtained 



2 See Army Mental Tests: Methods, Typical Results and Practical 
AppKcatians, Nov. 22, 1918, p. 23. Wash., D. C; L. M. Terman: "The 
Use of Intelligence Tests in the Army," Psychol, Bull. 1S18, 15, pp. 



177-187; "The Measurement and Utilization of Brain Power in the 
Army," Science, 1919, 49, pp. 221-226, 251-259. 

•War Dcpt. Adjutant General's Office. Forms CCP-1102, 5-18-18 
and CCP-1104, 5-22-18. Sec also "The Rating Scale," Psychol BuU. 
1918, 15, pp. 203-206. 
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from the Registrar's ofike and were grouped under three 
headings, as follows: 

*' Natural Science " included marks in biok^, chemistry, 
mathematics, physics, psychology, astronomy, geology and 
natural science. 

" Social Science " included marks in economics, education, 
history, politics, political science, sociology, philosophy and 
social ethics, and 

" Languages " included marks in English, Greek, Latin, 
Romance Languages, Germanic Languages, and for want of 
a better place to insert them, art, surve3ring and mechanical 
drawing. 

The writers were aware that these groupings were artificial 
and arbitraiT, but some grouping was necessary and these are 
perhaps as free from serious objections as any. 

The following table presents an analysis of the number of 
maiics in each subject-group possessed by various frequencies 
of students; thus, 7 students had only one mark in natural 
science, 13 students had only one mark in social science, 16 
students had 4 marks in the language and fine arts subjects, 
etc. : 



No. or Students Having 


No. OF 


Students Having 






Marks IN 








Marks IN 




Naof Nat 


Soc. 


Lang. 
andF. 


Total 


No. of Nat. 


Soc. 


aSlf. 


Total 


Marks 


ScL 


ScL 




Marks 


Sd. 


Sd. 










Arts 










Arts 




1 


7 


13 


6 


26 


14 


1 


2 





3 


2 


25 


9 


22 


56 


15 


5 


4 


1 


10 


3 


7 


9 


2 


18 


16 


2 


2 


1 


5 


4 


14 


7 


16 


37 


17 


4 


3 


2 


9 


5 


4 


11 


5 


20 


18 





1 


1 


2 


6 


9 


11 


8 


28 


19 


1 


1 


1 


3 


7 


4 


7 


8 


19 


20 


1 


1 





2 


8 


2 


5 


10 


17 


21 


2 





1 


3 


9 


6 


3 


7 


16 


22 














10 


3 


6 


10 


19 


23 





1 





1 


11 


2 


1 


2 


5 


24 














12 





5 


3 


8 


25 





1 





1 


13 


2 





2 


4 


Total 












101 


103 


108 


312 



Source C. ARMY RANK. The college attempted to keep 
a careful record, brought up to date, of the progress which 
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each of its students was makii^ both in the army and in 
the navy. The ranks were those which each held the day 
the armistice was declared. The ranks ranged from Private 
to Major. The following table and graph present the fre- 
quency of each rank. 



so- 






Number in 






4*. AitHr lUi/ics 






5- 






^^^ 1 
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It 




±*dM= 


15 


n^ 







Arhv Ranks 

Table Showing the Frequbncy op Each Miutary Rank 
Rank No. Rank No. 



1. Major 1 

2. l8t Lieut. 12 

3. 2nd. Lieut. (Ensign) 24 

4. Reg. Sa:gt.-Major 2 

5. l8t. Sergt. 1 



6. Bat. Sergt.-Major I 

7. Sorgt. 13 

8. Corporal 8 

9. 1st. QasB Private 1 
10. Private 53 

Total 116 



Statistical Treatment 

The statistical treatment divided itself into seven portions: 
(1) the inter-correlations between the estimates of the various 
judges, (2) the correlations between the consensus of opinion 
of tfie judges regarding the five traits and final army rai^, 
(3) the correlations between the five traits, (4) the correla- 
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tions between the five traits and the marks attained in the 
various subject-groups, (5) the average marks attained in the 
different subject-groups by each of the ten army ranks, (6) 
the correlations between final army rank and marks obtained 
in the three school subject-groups, and (7) the average ratings 
in each of the five traits received by each of the ten army 
ranks. It would have been valuable to have obtained an esti- 
mate of the reliability of each judge, but it would have involved 
time and labor which we could not very easily request. How- 
ever, from similar ratings in the army and from past informa- 
tion regarding the reliability of judges in estimates of this 
nature, we may take for granted a rather high degree of relia- 
bility of judgment. This is evident if we note the inter- 
correlation between the ratings of the various judges, espe- 
cially between judges 2 and 3. 

In view of the fact that the length of service varied from 4 
months to 18 months it was felt necessary to divide the 116 
students into two groups, one consisting of short-service men 
and the other of long-service men. In the latter group were 
placed all who had been in the army or navy more than 10 
months. This division was important because the long-service 
men would presumably have had a better opportunity to obtain 
promotion. In fact, the real test of the validity of various 
prognosticating criteria will depend upon how accurately these 
criteria have " sized-up " this group of long-service men. The 
short-service men number 26, the long-service men 90. 

The correlation-coefficients mentioned herein were all ob- 
tained by means of the formula: 

2fxy 

modified by one of the writers (S. C. K.) to correct some 
factors which make for too great a deviation from the true 
Pearson " r- formula :"* 

no-id's 

Results 

(1) The correlations between the estimates of the various 
judges. 

(a) Judge 1 and Judge 2. 

Judge 1 was not as reliable as either 2 or 3, owing to his 

^Discussed more fully by one of the writers (S. C K.) in his forth- 
coming monograph on the *'Block Design Test." 
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being somewhat pressed for time in connection with war- 
service matters. The correlations between the estimates for 
the five traits were: (Coefficients are positive unless otherwise 
indicated), (the probable errors of each coefficient are given 
in the summary table at the end of this article) : 

(1) physical qualities M 

(2) intelligence 40 

(3) leadership J7 

(4) personal qualities J9 

(5) value to the service M 

(b) Judge 1 and Judge 3. 

The correlations t)etween the estimates of these judges were 
somewhat better, though still unusually low : 

(1) physical qualities JS3 

(2) intelligence 29 

(3) leadership SO 

(4) personal qualities J8 

(5) value to the service 30 

(c) Judge 2 and Judge 3. 

The estimates of these two judges may be regarded as 
quite reliable. The correlations ^tween their judgments 
follow : 



(^/ 
(4) 
(5) 



1) physical qualities 41 

2) intelligence SI 

(3) leadership 65 

personal qualities 62 

value to the service 72 



The estimates of physical qualities showed the lowest cor- 
relation, whereas those of value to the service showed the 
highest correlation. 

The results of this analysis of the ratings of the three judges 
showed rather mediocre reliability of capacity to judge a 
student's rank with regard to any one of these traits. Of 
course, one of the judges may have been quite expert, but the 
bare data themselves do not reveal such expertness. In fact, 
an analysis of the correlations between final rank obtained 
in the army and the average trait estimates of the three judges, 
in the next division of our study, brings into still greater 
question this subjective method of prognosticating progress in 
the Army. Averaging the correlations of the estimates of each 
of the three judges for the five traits we obtain the following: 

r2> intelligence 40 

(1) physical qualities 43 

(5) value to the service .45 

(4) personal qualities 46 

(3) leadership 51 
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It is interesting to note that the judges showed least agree- 
ment on " intelligence " and most on " leadership." 

(2) Correlations between the consensus of opinion of the 
judges regarding the five traits and final army rank. 

(a) Short-service men. 

The correlations between the ranks which these men had 
attained during their short-lived stay in the army and the 
estimates of the judges of their capacities in each of the five 
traits enumerated, are as follows: 

(1) physical qualities 21 

(2) intelligence J9 

m leadership .08 

1 4) personal qualities 23 

Is) value to the service 30 

Of course, one might argue that these results clearly indi- 
cate that because these men were in the army but a short 
period, for this reason these correlations are low. However, 
the correlations are just as low for the long-service men. 

(b) Long-service men. 

n) physical qualities 28 

(2) intelligence « 14 

(3) leadership 14 

(4) personal qualities 21 

(5) value to the service 33 

Although estimates of " value to the service *' and final army 
rank show the highest or next to the highest correlations in 
both groups, this is not true for estimates of " intelligence," — 
which is highest in its correlation with final army rank in the 
short-service group, and lowest in its correlation with final 
army rank in the long-service group. It cannot be said that 
" intelligence " becomes less of a factor for success the longer 
one remains in the army. But here again one questions the 
value of subjective estimates of amounts of trait manifested 
by various individuals. However, there is the other alterna- 
tive: one might maintain that our judges are expert and that 
the explanation for these low correlations is the haphazard 
fashion in which the army attacks the problem of advancing 
its men or that it considers other factors, not here enumerated, 
the important ones for success. 

(3) The correlations between the five traits. 
The estimates of all the three judges were massed for the 
purpose of this inquiry. 

One looks forward with the greatest anticipation to that 
study which will attempt to analyze, psychologically and statis- 
tically, the factors entering into the moulding of human judg- 
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ments. What are the influences, conscious or unconscious, 
which make for idiosyncrasy, what is the mechanism of judg- 
ment, what makes for constancy, for reliability, how easily 
are judgments changed, what are the subjective criteria upon 
which judgments are based? The present portion of our in- 
vestigation is somewhat apart from our main thesis. Yet 
there is one striking feature of the data which may be sug- 
gestive to someone interested in this branch of research. There 
has been a good deal written regarding the Spearman-Hart- 
Burt explanation of intelligence as a ''general common fac- 
tor/' Evidence to that effect is deduced by a statistical analysis 
of the resuks of various psychological tests each of which 
measures some amount of this "general common factor." 
The " Hierarchy of Coefficients *' lends added weight to this 
hypothesis. We may here draw an analogy. It seems very 
probable that when one is passing a subjective judgment on 
the question of whether Person A possesses a certain amount 
of trait a, or b, or c, or d, that his judgment of practically 
all of these is affected by some constant factor x. For ex- 
ample, here is Tom Jones. Bill Smith is requested to record 
a personal estimate of his character, habits, self-control, in- 
telligence, sociability, — whether excellent, ^ good, fair, very 
poor. What probably occurs when Bill estimates, is that each 
of his judgments is affected by a constant factor, possibly 
unconscious, such as " Tom Jones is an excellent fellow. I 
like him because his ideas are very attractive to me." This 
example is not typical, of course, but is merely utilized to 
illustrate the point. That some such condition possibly exists 
is suspected from this table of data, which shows, somewhat, 
a hierarchy of coefficients. 



1 



1. Physical Qualities .27 

2. Intelligence 27 

3. Leadership 54 .52 

4. Personal Qualities 45 .56 

5. Value to Service 63 .62 

It is of interest to note (a) that the smallest correlation is 
between physical qualities and inteUigence (.27), and the high- 
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est between personal qualities and value to the service (.80), 
(b) that physical qualities and intelligence show the least cor- 
relations with the other traits whereas value to the service 
shows throughout higher correlations. 

(4) The correlations between each of the five traits and the 
marks attained in the various subject groups. 

The question, "To what degree do school marks and the 
trait estimates of judges coincide when prognosticating army 
success," is answered by the following correlations: 

Physical Intelli- Leader- Personal Value to 
qualities gence ship qualities the Service 

Marks in Nat. Sci. .15 .77 .40 .40 38 

Marks in SocSci. .34 .57 .41 .44 .46 
Marks in Lang. 

and Fine Arts .30 .66 .36 .33 3S 

The estimates of the three judges were averaged (Arith. 
Mean) in determining these correlations. It may be of in- 
terest to note that physical qualities showed the least corre- 
spondence with school marks, whereas intelligence showed 
the highest. In other words: Of all the five enumerated 
traits, intelligence was the most important in determining suc- 
cess in school work, whereas physical qualities, although im- 
portant, apparently were the least important of all. There 
is that much to the credit of the faculty and the grading 
system ! 

There may be some who would be interested in a further 
analysis: It seems from these data that intelligence is more 
of a factor for success m the natural sciences, least in the 
social sciences, with languages occupying a middle zone ! 

It is evident from the above table that with the exception 
of intelligence, school marks inadequately coincide, if at all» 
with the judges' ranking of these men in order of their abili- 
ties. The two criteria, apparently, are separate, — and, apart 
from intelligence, measure a somewhat different array of 
characteristics. 

(5) The averaae marks attained in the various subject 
groups by each of the ten army ranks. 

Since the short service men had representatives in only 
three ranks, private, sergeant, and second lieutenant, and be- 
cause of the difference in service time, the short and long- 
service men will be considered separately. The following tables 
present the number of men of each rank in the two groups: 
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Short Servicb Men 
Rank No. of Men 



LongSbrvicb Men 
Rank No. of Men 



3. 2Dd. Lieut (Enngn) 4 

7. Sergeant 2 

10. Private 20 

Total 26" 



1. Major 1 

2. Ist Lieut 12 

3. 2nd. Lieut. (Ensign) 20 

4. Reg. Sergt-Major 2 

5. IstSecgt 1 

6. Bat Sergt-Major 1 

7. Secgt. 11 

8. Comral 8 

9. l8t Oaas Private 1 
10. Private 33 

Total 90 

In considering the long service men, only ranks^ (2), (3), 
(7) and (10) will be compared since the number of men in 
the other ranks number no more than one or two. 

(a) Short-service men. 

Before presenting an analysis of the marks attained, a few 
words might be said in preface regarding the Reed College 
marking system (from the current Reed College Catalogue): 

"Gnudes in courses of study are awarded on a scientific 
rather than a personal basis, with definite credit for quality as 
well as for qtiantity of work. Until all school work can be 
measured by scales, made up of units that are equal in a de- 
fined sense, the best available grading is one of relative 
position in a series. The nearest approach to such a scientific 
basis for awarding collie credits appears to be a distribution 
following the normal probability curve, skewed to take account 
of the effect of selecting the student body. 

" Reed College has, from the outset, used ten grades, whose 
definitions have such a scientific basis. 



Gradea 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 






Proportion of 

Students 




5% 


10% 


15% 


20% 


25% 


15% 


6% 


4% 











" Grades 1-5 indicate that a student stands in the upper half 
of an average class ; grades 6-10 indicate that he is in the lower 
half. For example, 2 designates the work which will be done 
(in the long run) by the best 5% of all students, and 6 the 
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work done by that quarter of an average class standing just 
below the middle. 

" Grade 1 is rarely given, representing a degree of excellence 
attainable by not more than one student in four or five hun- 
dred; grade 10 records correspondingly bad failures. The 
lowest passable grade is 8; 9 is for ordinary cases of failure. 
The grades cannot be interpreted in qualitative terms, as good, 
poor, A, C, 90%." 

In the following table are presented the average school 
marks of the three different ranks : 





Average Marks IN 


Rank 


Nat. 
Sd. 


Soc. Language and 
Sd. FineArU 


3 

7 
10 


4.8 
5.7 
53 


5.9 5.2 
6.2 6.1 
5.0 5.8 



Rank (7) (Sergeants) had, on the whole, poorest marks 
throughout. Rs^k (3) (2nd Lieut. Ensign) was dearly 
superior to (10) (Private) on the basis of marks as one would 
naturally expect, this being especially true for marks in natural 
science. It mav or may not be surprising that the evidence 
was reversed for marks in social science, rank (3) being 
inferior to (10). Summarizing the data of the table it may 
be said that those of higher rank obtained higher marks in 
^e natural sciences and languages than those of lower rank, 
the situation being reversed, for proficiency in the social 
sciences. 

(b) Long-service men. 

In the following table are presented the average school 
marks of the four different ranks: 





AvBRAGB Marks in 


Rank 


Nat 
Sd. 


Soc. 

ScL 


Languam and 
FiheArta 


2 

3 

7 

10 


53 
6.1 
5.1 
6.1 


4.9 
5.5 
5.4 
6.0 


5.6 
63 
6.1 
5.9 



Rank (2) is, throughout, superior to rank (10) especially 
in the social sciences. And as a medium of prognostication 
these subjects would seem to have the advantage over other 
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subject^ in the college curriculum, this being the direct oppo- 
site of the indications apparent in the case of the short-service 
men in the previous division. Rank (7) was, on the whole, 
superior in marks for each group over rank (3). A matter 
worth mentioning is the variability of marks within each rank. 
A glance through the various school marks which the mem- 
bers of the different groups had obtained reveals as great 
an average variability of marks within each rank as is evi- 
dent between the averages of the different ranks. It is ques- 
tionable whether, except in extreme cases, one can rely on a 
school mark in any subject as an aid in prognosticating army 
promotion. This matter is more emphatically brought to our 
attention in the next item to be considered. 

(6) The correlations between final army rank and marks 
obtained in the three school subject groups. 

The correlations for the short and the long-service men 
are presented separately. 

Sii(»T-^RViCB Men 

Correlation Between Final Rank and 

Marks in Co-efiideiit 

Nat. Science .12 

Soc. Science .12 

Language and Fine Arts .06 

These correlation coefficients are so small that little if any 
diagnostic significance can be attached to the school marl^ 
for this group of men. 

Long-Service Men 

Correlation Between Final Rank and 

Marks in Co-effident 

Nat. Science .14 

Soc Science .24 

Language and Fine Arts .01 

The coefficients here are also small, but as in the previous 
section, marks in social science for the long-service men seem 
more reliable criteria for prognosticating army promotion, but 
even then, their value is greatly limited because of the many 
exceptions. 

On the whole, school marks, although they might aid prog- 
nostication, cannot be depended upon for sole support in this 
effort. In fact, poor as judges' estimates may be, they seem 
somewhat superior to school marks for diagnosing army 
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progress. This will be more apparent from the data in the 
succeeding section. 

(7) The average ratings in each of the five traits received 
by each of the ten army ranks. 

Short-Skrvicb Men 

Rank Phy^cai InteUi- Leader- Personal Value to Total 
Qiudities gence ship Qualities Service 



3 


12 


14.3 


10.3 


13.5 


33 


83.10 


7 


13.5 


10 


11.5 


11.5 


28 


74.50 


10 


11 


11.2 


10.6 


11.5 


27.8 


72.10 



Although the separate traits with the exception perhaps of 
" value to the service " do not demonstrate any clear correla- 
tion between height in rank and height in trait-score, never- 
theless the totals do show this clearly. Comparing the high- 
est rank (3), with the lowest, (10), the former throughout 
shows higher trait-scores than the latter with the exception of 
"leadership." "Intelligence" and "Value to the Service" 
show the greatest difference in trait-score between the highest 
and lowest ranks. This helps confirm the earlier claims for 
these two traits as more efficient for prognostication than any 
of the other three. 

Long-Servicb Men 

Rank Phyncal InteUi- Leader- Personal Value to Total 
Qualities gence ship Qualities Service 

2 11.9 12.5 12.2 12.9 34.8 84.30 

3 12 10.4 10.7 11.5 29.7 74.30 
7 11.7 11.7 11.3 12.2 29.7 76.e0 

10 10.4 10.1 10.3 10.9 26.2 67.90 

Here again rank 2, as well as rank 3, in each of the five 
traits, demonstrated considerable superiority over rank 10; 
especially is this true for rank 2. Again, with the exception 
of " value to the service " the separate traits do not show a 
clearcut correlation between height in rank and superiority 
in trait-score. It is of interest to note that rank 2, averaged 
more than 16 points higher in total score than rank 10. As 
was the case with school marks, so here, with regard to judges' 
estimates, rank 7 is apparently superior to rank 3 in the opinion 
of the judges, and apparently the army has not utilized the 
same criteria in its judgment and placing of these men. 
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Cor. 
No. 

1 

2 

3 

4 

5 

6 

7 

8 

9 
10 
11 
12 
13 
14 
15 



SumiARY OP THE CORRELATIONS 



Cases 



Facts Compared 



113 Estimates of Judge 

113 

113 

113 

113 

96 « • 

76 . - - 

39 

60 

35 

96 « * I 

76 

39 

60 « 

35 



Cor. P.E. 

and II re Physical Qualities .34 .06 

« « Intelligence .40 .06 

« « Leadershm 37 .06 

« " PersomOQualities .39 .06 

« « Val. to the Service .34 .06 

«III Physical QuaUties .53 .05 

• • Intelli{^nce .29 .07 
« - Leadership .50 .08 
« - Personal Qualities .38 .07 
« « Val. to the Service .30 .10 
« « Physical QuaUties .41 .06 
« « Intelligence .51 .06 
« « Leadership .65 .06 

• • Personal Qualities .62 .06 
« « Val. to the Service .72 .06 



16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 



26 
26 
26 
26 
26 
90 
90 
90 
90 
90 
21 
23 
25 
80 
80 
85 



Estof JiidgesforPhys.Qual.andRank 1-9 
Intelligence " 



mos. 



Nat. ScL marks 
Soc. Sd. « 
Lang.F.A. « 
Nat. ScL 
Soc. Sd. « 
Lang.F.A. « 



Pers. (^_ 
Val. to Ser. 
Phys.Qual. 
InteUignce 

Val. to Ser. 



10-18 



1-9 



10-18 



.21 
^39 
.08 
.23 
^30 
.28 
.14 
.14 
.21 
-.33 
.12 
.12 
.06 
.14 
.24 
.01 



.13 
.12 
.13 
.12 
.13 
.06 
.07 
.07 
.06 
.06 
.15 
.15 
.13 
.08 
.07 
.08 



32 
33 
34 
35 
36 
37 
38 
39 
40 
41 
42 
43 
44 
45 
46 
47 
48 
49 
50 



101 Nat. ScL « 

102 Soc. Sd. « 
108 Lang.F.A.« 
100 Nat. Sd. • 

Soc. Sd. « 
Lang. F.A. - 



and Jiidges' est. Phys. Qual. 



103 
108 



101 NatSd. 

103 Soc. Sd. • 

108 Lang.F.A.« 

101 Nat. Sd. - « 
103 Soc. Sd. « 

107 Lang.FJ^.« 
100 NatSd. • 

102 Soc. Sd. « 

108 Lang.F.A.« 

116 Est. of 3 Judges as 

116 « « « 

116 « « « 

116 • - - 



Intelligence 

« 
Leadership 

Personal Qual. 

a « 

u u 

Val. to the Ser. 



to Phys. Qual. and Intdl'nce 
u u u Leadership 
« Pers. Qual. 
• « « V.toSer. 



.15 
.34 
.30 
.77 
.57 
.66 
.40 
.41 
.36 
.40 
.44 
.33 
.38 
.46 
.38 
^ 
.54 
.45 
.63 



.07 
.06 
.06 
.03 
.04 
.04 
.06 
.06 
.06 
.06 
.06 
.06 
.06 
.05 
.06 
.06 
.05 
.05 
.04 
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Summary of the Correlations— Continued 

51 116 Est of 3 Judges Intdli'ence and Leader .52 .05 

52 116 « • « • « P»B.Qual. .56 .04 

53 116 « « « « - V.toSer. .62 .04 

54 116 « " " Leadership « Pers. Qual. .60 .04 

55 116 • • « • « V.toSer. .71 .04 

56 116 • « « Pers. Qual. " V. to Ser. .80 .03 

Conclusions. 

Summarizing the results of our analysis the f oUowfng would 
be our conclusions: 

(1) School marks are rather inefficient instruments for 
determining whether a student will make good progress in 
the army. 

(2) Htmian judges, with all their frailties, are, on the whole 
more efficient prognosticators of progress than the school marks 
which students obtain. 

(3) Of all the criteria for prophesying success, the safest 
are, first, judges' estimates of value to the service, and second, 
judiges' estimates of intelligence. In both cases, however, the 
correlations are low. If objective, rather than subjective, 
estimates of these traits had been used, the correlations might 
have been increased considerably. We already possess objec- 
tive instruments for measuring " intelligence,'* why not produce 
similar instruments for measuring " value to the service ?" 

(4) We have taken for granted, throughout this study, that 
the army was correct in its selections. We recognize that this 
assumption is not wholly valid; the real fault may not lie at 
all with our criteria but rather with the current methods in 
the army by means of which men are selected for superior 
positions. 

(5) The low correlations should be therefore explained as 
being due in part to 

(a) Imperfections in our standards of judging individual 
efficiency, marks and the estimates of judges ; 

(b) Imperfections in the system of army promotion; 

(c) Differences in the factors upon which the army bases 
its promotion and those upon which school marks and judges' 
estimates are based. 

(6) Although school marks and judges' estimates may serve 
as aids in prophesying army progress, other criteria must be 
relied upon for any satisfactory development of a prognosti- 
cating machinery. 
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THE DEGREE OF PH.D. AND CLINICAL 
PSYCHOLOGY 



By EoGAR A. Doll, Psychologist, N. J. State Dept. Institutions 
and Agencies 



There is reason to protest against the use of the degree of 
Ph.D. as a sine qua non in the " certification " of a clinical 
psychologist. It may have occurred to some who have enjoyed 
the discussions in this Journal of what constitutes clinical 
psychological expertness that one certifies himself as a clinical 
psychologist by the nature and character of his work and 
the consequent reputation therefrom ensuing. 

There seems to be a general agreement, however, that the 
degree of Ph.D. is an essential. The argument is presumably 
based on two considerations (a) that the degree is a testi- 
mony of advanced work and scholarly accomplishment, and 
(b) that it is something of a guarantee of superior general 
mental ability. Against (a) it may be protested that the attain- 
ment of this degree in academic psychology is no guarantee 
of either information or ability in clinical psychology, although 
undoubtedly it is a desirable and perhaps necessary basis for 
clinical psychology. Against (b) it may be argued that while 
those who hold the Ph.D. may be willing to admit its selec- 
tive influence as a measure of general mental ability there will 
be others who might contend that clinical psychology demands 
specific technical ability which may be more or less independent 
of general ability at the Ph.D. level of general ability. 

It is one of the functions of a clinical psychologist to dis- 
cover the exceptional case. He specializes in individual dif- 
ferences. The diagnosis of ability is determined without error 
only when the standard employed excludes all in whom the 
trait is absent and also includes all in whom it is present. 
Applying clinical methods to the diagnosis of clinical psycho- 
logical ability, can it be said that the Ph.D. degree is valid 
as a fixed condition of clinical psychological ability? We have 
seen in the Army that such was not the case. The overlapping 
of men with the degree who were failures as clinical psychol- 
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ogists and men without the degree who were successes was 
certainly too great to permit the use of the attainment of this 
degree as anything but a general criterion of clinical psy- 
chological ability. 

Some reasons for this are fairly obvious. Ability in the 
field of individual mental diagnosis is very largely a matter 
of specific training rather than general preparation. In the 
long run the man with a Ph.D. degree has the advantage in 
ease and rapidity of assimilating such training, but his attain- 
ment in general psychology is no guarantee of the specific 
preparation required. Moreover, a man of fair general in- 
telligence without the degree is able under good instruction to 
gain this specific ability independently of the Ph.D. degree 
(which is after all only certification for formal work in resi- 
dence at a college of accredited standing). 

Qinical ability is also founded on experience with clinical 
material under clinical conditions. This ability cannot be im- 
parted ex cathedra in the classroom. Hence a man with the 
Ph.D. degree who has specialized in the theoretical or academic 
considerations of clinical psychology is not qualified until 
he has served his " intemeship," which is perhaps equally as 
important as the Ph.D. degree itself. 

Moreover mental diagnosis is nearly as much an art as it 
is a science. A successful clinical psvchologist must have a 
successful " clinical personality," the clinical temperament," 
the ability to obtain and maintain that rapport which we so 
frequently hear mentioned. 

We therefore maintain the following general propositions: 

1. Clinical psychological ability demands specific training in 
the several allied fields of mental diagnosis (such as physiology, 
psychiatry, anthropometry and education, for example) as 
well as general training in academic psychology. 

2. This ability is based on experience and specific training 
as well as on formal academic preparation. 

3. This experience and specific training may be obtained 
independently of the Ph.D. degree. 

4. Some men with the Ph.D. degree are failures as clinical 
psychologists and some men without the degree are successes. 
The extent of overlapping is not inconsiderable. 

5. Therefore, while the degree of Ph.D. may be a desirable 
adjunct to clinical psychological ability, it is not a necessary 
prerequisite. 

In conclusion it is well to emphasize that we do not favor 
dispensing with the Ph.D. as a qualification for certification. 
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Undoubtedly many Doctors of Philosophy have become psy- 
chological clinicians, just as many clinicians have become Doc- 
tors of Philosophy. But it is important to emphasize that a 
candidate for certification ought to be free to offer demon- 
strated ability or knowledge in clinical psychology in lieu of 
the Ph.D. degree. The American Psychological Association 
does not insist on the Ph.D. degree as an unconditional quali- 
fication for membership ; a candidate may offer the equivalent 
of the degree in terms of demonstrated ability to pursue work 
of high character in psychology. There seems neither need 
nor justification for greater rigor of qualifications in the sub- 
ordinate field. 
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MINOR STUDIES FROM THE PSYCHOLOGICAL 

LABORATORY OF INDIANA UNIVERSITY 

VI. THE INFLUENCE OF (a) INADEQUATE SCHOOLING 

AND (b) POOR ENVIRONMENT UPON RESULTS 

WITH TESTS OF INTELLIGENCE* 



By LUELLA WiNIFBSD PrESSEY. 



I. Problem. The present paper is essentially a continuation 
of two studies which have already been briefly reported in this 
Journal; the first dealt with the comparative intelligence of 
country children and city children, and the second compared 
in a similar fashion children from good and from poor homes.* 
In these studies two group scales applicable from the third 
grade through high school were used. In each instance the 
test findings were looked to for aid in an understanding of 
various sociological and economic facts also discovered, in 
the course of the survey, with regard to the districts and 
families studied. And in each case the tests showed marked 
differences ; the city children rated distinctly above the country 
children, and children whose fathers were day laborers were 
foimd strikingly below the children of professional men in 
"native endowment." 

In the course of the survey, however, many facts were found 
which seriously brought in question the validity of these find- 
ings. Thus most of the country schools were " six months 
sdiools " and many of the children failed to attend regularly 
even during this brief period when the schools were open. 
The country district studied is, in fact, in a county notorious 
in the state for the inefficiency of its school system; the 
teachers are incapable and ill-trained, and the equipment miser- 
ably inadequate — in some instances the children were entirely 

* The paper was presented, in slightly different form, at the meetings 
of the American Psychological Association, Cambridge, Mass., Dec., 
1919. 

« Pressey, S. L., and Thomas, J. B., " A Study of Country Children 
in (1) A Good and (2) A Poor Farming District by Means of a 
Group Scale of Intelligence," Journal of Applied Psychology, Vol. 3, 
pp. 283-286, 1919, and Pressey, S. L. and Ralston, Ruth, " The Relation 
of Occupation to Intelligence as It Appears in the School Children of 
a Community," Journal of Applied Psychology, Dec, 1919, pp. 366-373. 
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without paper and pencils, the school work being done alto- 
gether on slates or on the blackboard! The group scale of 
intelligence given these country children presupposed (as do 
all such scales for use in the upper grades) a considerable 
degree of literacy and a fair reading vocabulary, and it in- 
volved the use of pencil and paper. It seemed, therefore, very 
possible that the poor showing made by these children might 
be the result quite as much of their inadequate schooling as 
of any lack in native intelligence. Somewhat analogous diffi- 
culties were encountered in evaluating the data obtained from 
children from homes at different economic levels. In good 
homes there is a background of general information and cul- 
ture, and a wealth of reading, which (it would seem) cannot 
but facilitate work on such tests. In the homes of the quarry 
hands and factory workers of the city studied, such influ- 
ences are notable for their absence; in fact, the parents are 
often illiterate. In short, these various accessory factors were 
felt to be so important, and so pervasive in their influence, that 
in the papers presenting these two studies it has been urged 
that results with a scale of performance tests (for the country 
children), and with tests for measuring home culture (as a 
check upon the " occupation of parents " data) would be neces- 
sary, before the findings with the tests of intelligence could 
be satisfactorily interpreted. 

It has been found possible, however, to get back of siich 
special influences for the most part, by the simple expedient 
of examining the children from these different groups at their 
entrance to school, or soon after, with the " Primer Scale."* 
This brief scale of intelligence does not involve literacy, nor 
school training; children from country and city should thus 
meet the examination on equal terms. And the scale is given 
to the children at so early an age that the home influences 
just referred to might be expected to have operated to a much 
less extent than later; particularly is it important that the 
children are tested before they have learned to read readily — 
any effects coming from the superior opportunities for read- 
ing in the good home are thus largely avoided. Comparison 
of results obtained from the younger children, using the Primer 

3 For a description of the scales mentioned in this paper see Pressey, 
S. L. and L. W>., A Group Point Scale for Measuring General Intelli- 
gence, Journal of Applied Psychology, Vol. II, 1918, pp. 250-269. 
"Cross-out" Tests, Journal of Applied Psychology, Vol. Ill, 1919. 
pp. 138-150; or Prcsscy, L. W., A Brief Group Scale of Intelligence 
for Use in the First Three Grades, /. Ed. Psychol, Sept., 1919. The 
material is also briefly discussed in the Bulletin of the Extension 
Division, Indiana University, Vol. V, No. 1, 1919. 
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scale, with results from the older children, using the more 
usual type of examination, should in fact not only make clearer 
the relative mental ability of the groups studied; the com- 
parisons should aid in evsduating the scales involved, and also 
in estimating the general importance of the various environ- 
mental factors mentioned, in mental test work. 

II. RestUts. The first data obtained for the present study 
with the Primer scale were from 183 country children six, 
seven, and eight years of age — ^all the children of these ages in 
fourteen country schools which had already been surveyed the 
year before with a scale for use in the upper grades (the 
" Schedule D " or " Group Point Scale ") containing ten tests 
of memory, controlled association, arithmetical reasoning, and 
so on. These results obtained the year before with children 
10-14 years old showed only 20% of the country children 
rating above the median for their age, when compared with 
norms obtained from city children. If, now, this poor show- 
ing of the country children were partly the result of their 
poor schooling, then the data obtained with the Primer scale 
should show a much greater per cent of the six, seven and 
eight year old countir children above the medians for their 
age. As a matter of fact, only 22% of these younger covmtry 
sdiool children score above the median for their age, as deter- 
mined from city children! 

It would seem reasonable to conclude, then, that the differ- 
ences found by both scales, between country and city children, 
were real diflferences in intelligence. The findings tally well 
with the frequent assertion of sociologists that the more in- 
telligent individuals in the farming communities are constantly 
moving to the cities. It should be said in this connection 
that the country district studied is of a distinctly poor char- 
acter, the land being hilly and unproductive, and many of the 
people being " poor whites " from the mountains of Kentucky. 

The second group of data obtained with the Primer scale 
consists of results from 337 children six, seven and eight 
years old — all the children of these ages — in the schools of 
an Indiana city of about 12,000 inhabitants. The Primer scale 
was given these children in the first three grades as part of a 
total survey of the school system — the "Cross-Out" scale 
being given to children above the third grade. These last 
results (using again the data from children 10-14 years old — a 
total of 548 cases), were then grouped according to the occu- 
pation of the fathers. Children whose fathers were pro- 
fessional men (doctors, teachers, ministers, lawyers) were 
placed in one group; children whose fathers were executives 



Digitized by 



Google 



94 PRESSEY 

(independent business men, foremen) constituted a second 
group. The third group was made up of the children of 
" artisans " (skilled worianen, machinists, railroad engineers) ; 
and the fourth group consisted of the children of unskilled 
laborers. The per cent, in each group, scoring above the 
median for their age, was then determined. These per cents 
ran as follows: 



Occttpation Group: 


Professional 


Executive 


Artisan 


Laborer 


No. of cases 


57 


105 


138 


248 


% above median for age 


85 


68 


41 


39 



It was felt, however, that these finding^ might not be truly 
a measure of differences in native endowment, because of the 
possible influence of the environmental factors mentioned 
above. As a check on these factors, results obtained with the 
Primer scale from the children 6-8 ye&rs old were, therefore, 
grouped in the same way, arid the groups compared by the 
same method. The per cents were as follows: 



Occupation Group: 


Professional 


Executive 


Artisan 


Laborer 


No. of cases 


21 


51 


127 


138 


% above median for age 


79 


60 


54 


38 



The results are again largely similar to the results obtained 
from the older children.^ 

It might be argued, however, that the two scales were test- 
ing, in different form, somewhat the same special abilities: 
particularly is this argument plausible since both scales used 
in this last study (of the correlation of occupation with in- 
telligence) are "cross-out" scales, and are largely similar 
in general scheme, presentation and problem. To obtain some 
light upon this question the results with the Primer scale were, 
therefore, analyzed by test 

The first test of the scale consists of groups of dots, each 
group of dots making a pattern; there is, however, one dot 
in each group which is outside of or spoils the pattern — this 
dot the children are to cross out. The second test is made 
up of squares, each square containing two objects which are 
similar, in some important way, and one object which is dif- 
ferent from the other two: tnis different thing the children 

^ It should be pointed out that the occupational groups are of differ- 
ent sizes, and that the smallness of the professional groups, in both 
instances, besides lowering the reliability, decreases the dispersion of 
the distribution and so exaggerates the superiority of this group as 
measured from the median of the entire group. For comparative 
purposes, however, as used here, the method serves well enough. 
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are to cross out. The third test shows at the top of the page 
four forms — a triangle, a square, a cross, and a circle. Below 
are squares or " boxes *' containing " blocks '* which are to be 
fitted into the four places at the top of the page : but in each 
"box" there is one piece which will not fit in — ^and this 
extra piece is to be crossed out. The last test shows pictures 
in each of which there is something wrong — this wrong part 
is to be crossed out 

The second and last tests thus involve considerable infor- 
mation: these two tests might, then, be influenced by home 
environment. But it is hard to see how such environmental 
factors could operate to as great an extent in developing a 
child's ability to recognize dot patterns, or assist him m dis- 
criminating the geometrical forms of the third test. It should, 
therefore, be possible, by comparing results on the four tests, 
to form something of an estimate of the " reliability " of the 
measures obtained : in so far as the findings are constant from 
test to test of the scale used, it might be possible even to infer 
that similar findings would be obtained if other tests still were 
employed. The following table shows the per cent of children 
in each occupational group scoring above the median for their 
age, on each of the four tests : 



Occupatioiial Group: 


Test 1 


2 


3 


4 


Professional 


68 


70 


72 


71 


Executive 


62 


62 


58 


61 


Artisan 


50 


61 


51 


54 


Laborer 


40 


38 


42 


47 



As will be seen, the per cents are distinctly constant from 
test to test. The diflFerences are quite as great on the two 
tests which we would expect least influenced by home environ- 
ment as they are on the two tests we would expect most 
sensitive to such influences. 

Since then, the findings obtained from the two scales are 
consistent, and the findings are consistent from test to test, 
it seems reasonable to infer that the differences found between 
the occupational groups are probably true differences in a 
fundamental, underl3ring general intelligence or native endow- 
ment. And if we may assume that intelligence is hereditary 
we may argue back to the conclusion (regarding the parents 
of these children) that there is a positive correlation l^tween 
occupational level and native ability — in general, at least, people 
find the level of work for which they are capable. 

III. Discussion. The writer does not wish to press these 
conclusions. It is evident that all these tests are pencil and 
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paper tests. The country children, young as well as older, 
are more shy with strangers than are dty children. The 
children from well-to-do homes often have nursery games 
somewhat analogous to the tests. 

But in so far as the results are valid, as thus interpreted, 
they have further interesting bearings upon certain general 
problems of mental measurement which should be pointed out. 
In the first place, these successive agreements between the 
scales used contribute to the validation of both t)rpes of exam- 
ination. The scales for use with the older children stand 
out as, for the most part, untouched by environmental factors 
which might very well be expected to influence, in an illicit 
way, the findings. The substantial agreement oi the Primer 
scale with the Standard tests included in the scales for the 
upper grades is evidence to show that the Primer scale is 
also measuring " general intelligence." More interesting still, 
however, is the way in which there emerges, from these vari- 
ous comparisons, the outline of a unitary "general ability." 
The data is obviously most inadequate as the basis for any 
inferences regarding such a large problem. But the writer 
cannot but feel that a large number of such simple and direct 
comparisons, between a variety of groups and using a variety 
of tests, are more needed at present in the study of general 
and special ability than more elaborate mathematical analyses 
of a relatively small amount of data. 

Summary 

The paper reports comparisons of (a) country and city 
children, and (b) children from different economic levels, by 
means of a group scale of intelligence applicable to the first 
three grades. It was found that 

(1) 22% of the country children 6-8 years old score above 
the median for their age made by city children. 

(2) Children of professional and business men rate dis- 
tinctly above children of laboring men and mechanics. 

(3) Similar results were found in surveys by means of 
scales applicable to the older children. It is, therefore, argued 
(a) that these differences previously found were differences 
in innate ability, not in schooling or home culture, and (b) 
that there was some general factor (presumably general men- 
tal endowment) independent of the particular tests used, with 
respect to which these groups differed. 
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VII. FIRST REVISION OF A GROUP SCALE DESIGNED FOR 
INVESTIGATING THE EMOTIONS, WITH 
TENTATIVE NORMS. 



By S. L. Pressey and O. R. Chambers 



1. The Tests, In the June number of this Journal^ cer- 
tain " tests " were described intended for the investigation of 
emotional interests and distractibility. The tests were shortly 
after given to three small groups, one consisting of college 
students, another composed of girls from the State Industrial 
School, and a third made up of dementia praecox cases from 
two hospitals for the insane. The data were decidedly meager, 
but served nevertheless to indicate faults so marked as to make 
it seem wise to revise the tests before experimenting with 
them further. The tests as thus reconstructed may be de- 
scribed briefly as follows : 

Test I. AflFective Spread and Displacement: The test con- 
sists of 25 lists of words ; each list contains five words, making 
a total of 125 words in all. All but 25 of the words name 
things more or less unpleasant. The subjects are told to read 
through the list and cross out every word that is unpleasant 
to them. There is no time limit, every subject being given 
time to finish. After the last subject has finished the last 
line the directions are that the group is to go through the 
list again, and draw a line around the one word in each line 
which is most unpleasant. In scoring, the total number of 
words marked unpleasant is first counted and used as a meas- 
ure of aflfective spread or tendency to emotionalize. The 
number of lines in which the subject chooses as most unpleasant 
a word other than the word so chosen by the most of the 
average cases (that is, the modal word) is then counted and 
the sum used as a measure of emotional peculiarity or dis- 
placement^ 

1 S. L. Pressey and L. W. Pressey, " Cross-out " Tests, with Sugges- 
tions as to a Group Scale of the Emotions, Journal of Applied 
Psychology, Vol. Ill, 1919, pp. 138-150. 

2 Those who are familiar with Freudian terminology and theories 
will understand at once from the name of the test the general notion 
bade of it, and the type of abnormal mental condition to which it is 
hoped the test will be sensitive. In fact, the five tests of the " scale " 
might, not altogether inaptly, be described as an attempt to investigate 
Freudianism experimentally. 
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The first five lines of the test run as follows: 

1. disgust fear sex suspicion aunt 

2. roar divorce dislike sidewalk wiggle 

3. naked snicker wonder spit fight 

4. failure home rotting snake hug 

5. prize gutter thunder breast insult 

Test II. Emotional Distractibility : The test consists of two 
parts: the first half is a paragraph of very commonplace 
and stupid reading matter, with 20 irrevelant words scattered 
in through the test ; the subject is to read through the passage 
and cross out all irrelevant words. A rigid time limit of 
one minute and twenty seconds is set. At the end of that time 
the subjects are told to stop and go through the second para- 
graph in the same way. This second paragraph is sown in 
the same way with 20 irrelevant words. But it is a very g^e- 
some description of a medieval execution. The score con- 
sists of the number of extra words missed in the first passage 
less the number of extra words missed in the second, the 
idea being that the emotional excitement of the second passage 
should cause the subject to overlook more irrelevant words 
here.* 

The first five lines of each passage are given below: 

This evening's the " Herald " says that the Milton property 
east of 3rd Street was sold this man morning to Smith and 
Cooper out of Chicago. It seems that is Smith has been, 
for some time, looking for a good poor piece of land in the 
business heart part of town upon rock which he might build 
another boat of his chain of 10c stores. 

In the past time the most horrible and terrible forms of 
punishing crime were far common. Taunton tells many of an 
execution for treason under the most cruel and revolting in 
conditions. The man was hanged for three minutes, then, 
when his struggling wits began to decrease, was cut down, 
stripped, and his abdomen wide. 

Test III. Moral Discrimination and Experience: The test 
is superficially somewhat similar to test I. It consists of 25 
lists, each of five moral terms. The subjects are told to gp 

» The test was developed on the basis of some unpublisheed work done 
by one of the writers (Dr. Pressey) some years ago at the Psycho- 
pathic hospital with dementia praecox and psychopathic personality 
cases, but dates back ultimately to a card sorting test with pictures for 
distraction described by Boring (Boring, E. G. "Learning in Dementia 
Praecox" Psychological Monographs, Vol. 15, 1913, No. 63, pp. 101). 
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through the lists and cross out in each list the thing that they 
consider worst. There is no time limit. The subjects are 
next told to go through the list again and draw a line around 
the wrong act or idea which they consider most common. 
The scores consist of the number of deviations from the most 
commonly chosen worst act and the most frequent sin. The 
idea has been that it might be illuminating to set over against 
each other moral and intellectual or experiential judgments 
in this way. As a matter of fact the judgments as to most 
common sin have proven most interesting.* 
The first five lines of the test run as follows: 

1. insulting, quarreling, mislead, hurting, carefulness. 

2. borrowing, stealing, gambling, honesty, begging. 

3. hate, rudeness, liking, dislike, fighting. 

4. drunkenness, temperance, cursing, flirting, beating. 

5. religious, crossness, smoking, stealing, swearing. 

Test IV. Free Association: The test consists of a list of 
25 words in capitals, each word in capitals being followed by 
a list of five other words in small letters. The subjects are 
told simply to go through the lists and draw a line through 
the one word in each list which is most closely connected in 
their minds with the word in big letters at the beginning of 
the list — they are to cross out the wor4 which they most 
naturally think of in connection with the first word. There 
is no time limit. The score consists simply of the nimiber of 
variations from the most common associate.* 

^ The test is an attempt to pat in reasonably satisfactory and objective 
form an ethical discrimination test. It is therefore related to tests 
of this general nature described by Healy, Tests for Mental Classifi- 
cation Psychological Monographs, No. 2, Vol. 12, 1911 and Guy Fcmald, 
The Defective Delinquent Class: Differentiating Tests, American 
Journal of Insanity, Vol. 68, No. 4, April, 1912. 

•The test derives directly from the Kent-Rosanoff article (Kent, 
Grace Helen and Rosanoff, A. J., A study of Association in Insanity, 
AmericoH Journal of Insanity, Vol. 67, Nos. 1 and 2, 1910). The list 
of words in capitals is from the Kent>Rosanoff list of 100 words and 
most of the other words used are from their list of associates. As will 
be seen, the list begins with one association of very high frequency, 
according to their tables, in each line and goes down to absolute 
irrelevancy as near as the writers could make it 

It should also be mentioned that the writers have asked, after the 
associations have been marked, that the subjects go through the lists 
again and draw a line around each word that means "something to 
cat or drink, or something to wear, or a part of the body f there are 
25 such words in the lists. This part of the test was planned as merdy 
a rough intelligence test for check on the general mental level of the 
groups which might be investigated. It is perhaps better omitted ; the 
omission of this part may affect results on the last test, however. 
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The first five lines of the test run as follows : 

1. BLOSSOM nice flower pour poison cheese 

2. LAMP fear cheer match light dogs 

3. BATH nakedness hen water danger paper 

4. KING dog tyrant fish queen grade 

5. SLEEP midnight rest beautiful worry baseball 

Test V. Emotional Memory: The test consists of a list 
of one hundred words, fifty of which have occurred in the 
previous tests, and fifty of which have not. Of these fifty, 
twenty-five have been chosen as emotional and twenty-five 
as unemotional. The subjects are told to go through the list 
and cross out all the words which they think have oc- 
curred in the previous tests. Two scores are obtained: (a) 
excess of emotional over unemotional words correctly remem- 
bered, and (b) excess of emotional over unemotional words 
which were marked as remembered but which did not occur 
in the previous test.* 

The first five lines of the test run as follows : 
fear finger paper story nude rose east brutal slashed 
liquid business hacked crave Smith hate screamed piano 
ground dollars author belly ripped rock yards pears flirting , 
railroad vomit cow horrible seduce trust mind gloomy water 
lover funeral tall rape shrieked parts pencil ghastly 

2. Nature of the Revision. The general nature of the 
revision may be very briefly indicated. The four tests first 
experimented with have already been described in the pre- 
vious article referred to above (note 1). These tests were 
given to some thirty college students, and about the same 
number of girls at the state reform school and dementia prae- 
cox cases at two state hospitals.^ Study of results from 
these three groups led to the following general conclusions. 
In the first place, tests for use with such widely different 
groups (and particularly group tests for use with the insane) 

• The notion of the test derives from the experience of one of the 
writers (Dr. Pressey) as subject for an experiment by Tolman ; among 
other subjects Tolman investigated the influence of affective toning 
upon memory (Tolman, E. C, and Isabelle Johnson, Am. J. Psych., 
Vol. 29, 1918, pp. 187-195, but the subject, is of course an old one with 
a very considerable literature. 

7 Acknowledgments are due to Dr. Kenosha Sessions, superintendent 
of the Indiana Girls ' School, to Dr. Max Bahr, of the Central Indiana 
Hospital for the Insane, and to Miss Hazel Hansford, psychologist and 
field worker at the Southeastern Indiana Hospital for the Insane, for 
their kindness and help in securing the data. 
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cannot be time-limit tests. In the second place, every eflfort 
must be made to use words which will be known to everyone ; 
limitations of vocabulary must be carefully considered, par- 
ticularly in working with delinquent groups. In the third 
place, some method is desirable by which response in chance 
fashion to a test may be found out ; otherwise, in scoring papers 
from psychotics, it is often impossible to tell erratic chance 
reactions from erratic thinking which is nevertheless on the 
problem. 

As a result of these considerations only one time limit 
test was kept in the revised form presented above. Com- 
parison of girls' school and college results served to indicate 
at least the most gross differences in vocabulary. And a 
check on chance reaction was sought by the use of " jokers." 
That is, in each line of the *' what is worst " test there is one 
virtue, and in each line of the " unpleasant " test there is one 
word which is either positively pleasant or at least not marked 
as unpleasant by any one in either the college or the girl's 
school group.' In scoring the tests these jokers are first 
glanced over, and any records showing an appreciable num- 
ber of responses on the jokers thrown out. In an effort to 
obtain the maximum amount of information from each test 
the first, third, and fourth tests are made to 3rield double 
scores; the device appears to work very well (in fact, the 
writers seriously considered making one test yteld three scores) 
and would seem of some general usefulness. 

The changes made in the individual tests cannot be gone 
into in detail. It may be said shortly that the data obtained 
from the three groups mentioned above were analyzed very 
closely, elements which appeared differential seized upon and 
more like them added, and the sensitivity of the tests increased 
by proper grouping of items. The materials were also arranged 

^ In these two tests the jokers are put into the test according to a 
set scheme, in order to facilitate scoring; the joker is fifth in the first 
line, fourth in the second line, third in the third line, and so on, the 
series banning over again in the sixth line. This scheme is not 
readily hit upon by a subject. And it is also (a more important point) 
not the sort of thing a subject might fall in with unwittingly as the 
result of an automatism; a subject might react uniformly to the first 
word in every line, or the middle word, he might take progressively 
the next word, but he would hardly be likely to work backward in this 
way. These considerations are particularly important in the first 
test, where not only the jokers, but all the classifications, run in this 
way. 
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more systematically, and so as to permit of more ready 
analysis. One test was dropped altogether, one test of the 
"Cross-out" scale* radically made over and included in this 
series, and the free association test added. 

The general nature of the changes made may be illus- 
trated by the revision of the first test. The first results made 
it evident that there are certain words, such as murder, which 
practically everybody, — ^psychotic, delinquent, or college stu- 
dent,--<onsider unpleasant ; other words such as smile every- 
one considers pleasant. Such words are evidently of no value 
(except as " jokers ") ; they are not differential. Therefore 
in the final form no word of the first test was kept unless 
it was considered, by more than 20% and less than 80% of 
both the college group and the girls' school group, to be un- 
pleasant; words of about the same percentage of unpleasant- 
ness were also put together in the same line in order to make 
the test sensitive to small difference of opinion or affective 
attitude. But it was felt that this was not enough. It was to 
be expected that the delinquents and psychotics would differ 
from normal folk not merely by more random choices; the 
at3rpical cases would show instead peculiar but consistent 
trends. A guess was therefore made as to what trends would 
be interesting to investigate, and words of five types chosen, 
words which would be unpleasant because of their relation 
to disgust, fear, sex, or self-feeling, and the jokers. One of 
each type of word was put in each line, after the scheme used 
with the jokers; the key to the arrangement is given by the 
first line of the test, as shown above. 

3. The Tentative ^' Norms" The tests, as thus revise^,, 
were then given to a total of 101 college students, 49 men and 
52 women. From these results the following tentative norms 
were worked out: 

Test I. (a) per cent of each sex, and of the entire group^ 
considering each word unpleasant; (b) number of deviations, 
in choice of the most unpleasant word, from the modal choice. 

Test II. differences between number of extra words cor- 
rectly crossed out in unemotional and emotional passages un- 
emotional less emotional). 

Test III. (a) per cent, for each sex and for the entire group, 
considering each wrong act worst, and most common; (b) 
number of deviations, in choice of the worst and the most im- 
pleasant, from the modal choice. 

• Sec the previous article mentioned in note 1 above. 
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Test IV. (a) per cent, for each sex and for the entire 
group, choosing each word as an associate; (b) number of 
deviations, m dboice of the associate, from the modal choice.** 

Test V. (a) excess (or the reverse) of emotional over un- 
emotional words correctly remembered; (b) excess (or the 
reverse) of emotional over unemotional words marked, but 
not actually occurring in the previous tests. 

4. Purpose of the Tests. The writers realize, very de- 
cidedly, the crudeness of the tests, and the inadequacy of the 
data accumulated so far. But the data already obtained will 
serve at least for a rough first orientation in dealing with 
any further material which may later be accumulated. Re- 
sults from a group of factory hands or other relatively un- 
skilled laborers, from a group of colored adults, a group of 
delinquents, and a pathological group (preferably neurotics 
or early dementia praecox) are particularly desired. The 
writers are not so situated that such data are readily obtain- 
able ; it is with the hope that others, who are already working 
with such special groups, may be interested to thus experi- 
ment that the present paper is being published. The test forms, 
and tabulations to date, will be gladly furnished to any who 
may be interested to do such work. 

And as an indication of what can be done in the develop- 
ment of such data the writers wish to present very briefly, 
in closing, the results of an analysis, for sex differences, of 
the responses on the first test. The subjects were told to 
cross out the words which were unpleasant to them. It was 
found that 55% of the women marked more words as un- 
pleasant than did the median man — ^that is, the difference 
was negligible. However, the per cent, for each sex, marking 
each word as unpleasant was next found, the twelve most 
differential words located, and the number of these words 
marked as unpleasant by each man and each woman coimted. 
It was found that 94% of the women marked more of these 
words unpleasant than did the median man! 

We do not, of course need mental tests for the distinguish- 
ing of the sexes; and it may be said that the writers have 
tried, so far as possible, to avoid items on which sex differ- 
ences might appear so that separate sex norms would not 

^<>The number of correct responses, in making the "things to eat 
or drink, things to wear, and parts of the body " were also tabulated ; 
but the measure would aeem of little valuo. 
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be necessary.** But this bit of analysis will show something 
of the possibilities of development contained in the tests; 
the writers see no reason for doubting that differential groups 
within each test, which shall prove little less effective, may 
be found in working on neurotics and psychopathic delinquents. 
At least there is sufficient evidence to make the experiment 
seem worth while. 

A CORRECTION 

In a minor study entitled "The Efficiency of the Group 
Point Scale in Prognosticating Success and Failure in Junior 
High School," in tfie December number of this Journal, a 
prognosis chart or percentage correlation table for prognostic 
purposes was presented. By some mischance this chart was 
confused with a similar chart for correlation of score with 
Teachers* Estimates. The correlation coefficient g^ven in the 
article was correct. But the chart should read as follows : 

Division into fifths — test score — 
1 
Division into 
fifths 
according 
to school 
marks 

In each array one is lowest and five highest. 

S. L. Pressey. 

^1 For the most part this has been accomplished. Thus on the fourth 
test the two sexes differ in only two instances, in their selection of ^e 
worst sin. But nevertheless only 21% of the women differ as much 
as the median man, from the modal selection— a result due perhaps to 
wider experience on the part of the men. It is also interesting that 
half again more sex words were selected by the women than by the men 
as most unpleasant, and that the men exceeded the women in sdection 
of the " fear " words. 

It should be added in this connection that the tests are by no means 
wholly a masculine production; each writer frequently consulted his 
wife, and the majority of the items of the first form were selected by 
Mrs. Pressey,— whose suggestions and help throughout the entire course 
of the work have been of the greatest value. 
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C. E. Seashore. The Psychology of Musical Talent, Silver, Burdett 
and Company, Boston, 1919, p. xvi-|-288. 

In this volume Professor Seashore has assembled his tests on 
musical talent, which he presents with typical results in simple and 
untechnical language. Though the volume is addressed to students 
of applied psycholo^, the author has evidently had also in mind the 
music supervisor with little psychological training, for one misses a 
searching analysis of the data collected, and the treatment can hardly 
be called systematic though a very definite scheme of classification 
underlies the work. 

Musical talent is considered under five heads: musical sensitivity, 
musical action, musical memory and imagination, musical intellect and 
musical feeling. As a basis of analysis the author accepts four auditory 
attributes — pitch, intensity, duration and extensity. Tests for the first 
three of these " senses " are described and their elemental importance 
magnified. " Pitch is to the musician what color is to the artist — his 
medium of expression." Accordingly a test of pitch-discrimination is 
taken to be a basic test of musical ability. The experiments seem to 
indicate that the physiological limit can be attained after a brief prac- 
tice period and that it does not change with age or further training, 
nor vary with respect to sex. If pitch discrimination alone is poor we 
can predict a corresponding inferiority in all its derived factors — 
though good pitch discrimination does not insure excellence in these 
other factors. As a result of testing large numbers for pitch-dis- 
crimination. Seashore has reached the following practical conclusions. 
A person who discriminates 3 vibrations or better at the level of 435 
d.v. may become a musician. One whose discrimination falls between 
3 and 8 d.v. should have a plain musical education; between 9 and 
17 d.v. one should have it only if a special inclination for some kind 
of music is shown; one whose discrimination requires 18 vibrations 
or more should have nothing to do with music. 

A normal distribution curve indicates the percentage of persons 
giving varying percentages of right judgments, the lar^^est number, 
something over 30 per cent, giving 85 per cent of right judgments in 
these tests. Tests are also recorded for the range of pitch, the results 
showing increased sensitivity from the level of 64 d. v. to 128 d. v. with 
an at first gradual and then more rapid decrease from 256 d.v. upwards. 

With regard to the "sense " of intensity, interferences in hearing 
are briefly discussed together with the phenomena of tonal gaps and 
tonal islands. The use of the audiometer is described and also the 
pitch-range audiometer for intensities at different pitches. The stand- 
ard of acuity for a very good ear allows the faintest sound of the 
instrument to be heard at each pitch-level from 200 to 3200 d.v., but 
there is no indication that these intensities are either subjectively or 
objectively equal. If they were, the results would be at variance with 

105 



Digitized by 



Google 



106 BOOK REVIEWS 

the normal curve, esUblished by Max Wien.^ Little difference is found 
between the acuity of adults and children. No improvement was ap- 
parent after training and blind persons were found to possess no better 
hearing than persons with normal vision. 

In studying the sense of time the author assumes a motor theory 
of response. Discrimination as fine as 1/100 of a second is extraor- 
dinary, while a record as ix>or as 1/2 of a second is equally rare. 
Though children do less well than adults in these tests, improvement 
with practice is attributed to a growing knowledge of the time-^ooess. 
The very slight correlation of precision in hearmg the duratioos of 
tones or of short intervals with lessons in music leads to the con- 
clusion that either musical training does not improve a capacity so 
elemental as the time sense, or that those with a good time sense are 
no more apt than others to be selected for a musical education. Pitch 
and time are found to be fairly independent variables; the need of a 
good time sense in music being regarded as contingent. 

The sense of rhythm is reduced to five fimdamental capacities; tiie 
senses of time and of intensity, auditory and motor imagery and a 
motor impulse for rhythm ; its measurement is correspondii^v reduced 
to these elements. Timbre is described as a complex of pitdies. The 
criteria for judgments of consonance are listed as blendinff, smoothness 
and purity. The instruction for the consonance test is to "give the 
decison on blending alone if the degree of blending (in me two- 
dang comparison) is perceptibly different; if not ms3ce the decision 
on smoothness — and, if there is no difference in either smoothness or 
blending base the decision on purity." A normal order resulting from 
experiments with tfie piano is recorded and two comparison tests, a 
longer and a shorter, are described. The results of these tests show 
them to be independent of the age of observer and, while improve- 
ment with training is evident, it is not so noticeable as one might 
suppose. The test may, therefore, be used to advantage before the 
child knows anything of music. 

In the discussion of auditoiy space, the ability of the ears singly and 
together in determining the direction of a source of sound is described 
and explained in terms of difference in intensity. The sense of 
extensity ''varies exactly parallel with pitch; there is an inseparable 
duality. "For the purpose of rating talent it is therefore unneces- 
sary to concern ourselves with the isolation of the sense" ; a conclusion 
which must «eem of doubtful validity to those who have followed the 
recent studies of hearing; particularly Rich's investigations of the 
volume threshold which demonstrate that its limen is quite different 
from that of pitch. 

Seashore differentiates volume and extensity, preferring to use the 
former term as a combined effect involving several factors such as 
extensity, intensity, timbre and reduplication of sound. 

On the subject of motor control, the basic motor capacities are 
outlined with respect to time as motility, timed action, response to a 
simple signal, action upon choice and serial action; with respect to 
movement; precision, discrimination, strength and endurance. A 
variety of tests are described employing the chronograph and chrono- 
scope, the simple tapping test being adopted as an index to motility. 

Under the head of musical action Seashore describes the use of his 
tonoscope, and some of the chief results secured with it in measuring 
voluntary control of pitch. 

In considering musical imagery and imagination a somewhat exag- 

1 Pfliiger's Arch, f . d. ges. Physiol., 1903, 9/, pp. 1 ff. 
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gerated importance is attached to the auditory image. The restiits of 
a questiomiaire indicated that " as a rule musicians who rate themselves 
low offer some excuse, explaining that they suffer from defective 
capacity in this particular ; that they have neglected to develop it ; that 
they have been engaged in some sort of musical business which does 
not make it necessary, etc." Whatever importance may attach to 
imagery it can hardly be doubted that the specific imagery of a special 
sense is less significant in indicating a particular talent of appreciation 
or execution than was once supposed to be the case; and musicians 
who deplore their lack of auditory imagery may be unduly impressed 
when their attention has been called to some apparent deficiency in 
their ability to hear inwardly. 

As for musical imagination Seashore's treatment is 8U^[gestive rather 
than precisely anal3rtiad. " Imagination proper ** he writes, *' is not a 
specific mental process, as is sensation or perception, bttt is rather a 
designation for certain group functions of images, associations, 
thoughts, feelings, and efforts in countless permutations." A statement 
equally vague deals with the language of music : ** It is to the credit 
of language if it convey one specific idea and that only; it is to the 
credit of music if it lead to a richer self-expression transcending the 
bounds of defined concepts and literal form." In the opinion of the 
reviewer, music transcends ** the bounds of defined concepts " no more 
than does verbal language, but the definitton of the musical concept as 
distinct from certain of the elements of auditory experience is lacking 
in this work. 

Of the remaining chapters the one on musical memory describes 
tests for memory-span and retention, and includes a discussion of 
learning curves and absolute pitch. With respect to musical intellect 
a sound statement is made that ** musical thought is a specialization in 
dealing with the problems which arise in music. Although the form 
laid content of the tiiought are different, it requires the same kind of 
logical grasp as in mathematics or philosophy." Yet no effort is made 
to clarify the peculiar form and content of music, as mi^t perhaps 
have been done by reference to the work of Stumpf, Lipps, M. F. 
Meyer and W. V. Bingham. Indeed Seashore's conclusions rest almost 
exclusively upon results obtained in his own laboratory. The chapter 
on musical feeling is equally vague. 

The final chapter deals with pedagogical hints and the advocacy of 
a consulting supervisor of music who may be competent to test the 
musical talents of children in the schools and to judge them in accord- 
ance with their capacities and interests. 

For all the technical ingenuity with which Seashore has attacked the 
important problem of musical diagnosis one feels that somehow the chief 
feature of musical talent has escaped his "dragnet;" ^is being the 
ability to conceive and to think in terms of the musical interval. The 
neglect of the interval casts a doubt upon his ** basic " test of pitch. In 
discriminating pitch within the range of 3 vibrations at a level of 435 
d.v. we are not dealing with a musical interval but with a mere 
difference of "height." The difference between a semitone above 
435 d. V. in just intonation (464 d. v.) and the same note in tempered 
intonation (460 d.v.) is greater than the limit which Seashore's test 
makes the basis of a musical diagnosis. The reviewer believes that the 
attitudes wherein one judges height and interval dre quite different and 
that they rest upon different " senses." In view of Rich's work on the 
volume threshold it seems highly probable ^at the independent attribute 
or " sense of extensity " which Seashore neglects as being " exactly 
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parallel with pitch " is nevertheless the elemental foundation upon which 
our judgments of interval and the logic of music are based. In the 
report on pitch discrimination at different levels of pitch, we find a 
curve which indicates that in terms of fractional parts of a tone keenness 
in the sense of pitch remains approximately constant from 256 d. v. to 
2048 d. V. This curve therefore parallels Rich's limens in that a certain 
fraction of the vibration appears to correlate with a just noticeable 
difference of " pitch/' as does a similar fraction with a just noticeable 
difference of volume. It would thus appear possible that Seashore's 
pitch test involves both pitch-height and pitch-interval. Some observ- 
ers judging pitch-height may discriminate differences of 3 d. v. and 
better at the level of 435; while others influenced by the attitude of 
interval-difference may tend to require differences exceeding the 
limen of volume, which at this level would be about 9 d. v. 

How far this neglect of a direct test for the sense of interval may 
impair the results of Seashore's diagnosis, it is not easy to say. A 
corrective is of course to be found in several of tlje accessory tests 
which measure the sense of interval indirectly, such as those for 
consonance and those emplosdng the tonoscope, in singing intervals 
and in voice control; but the emphasis which the author places upon 
the test of pitch can not seem just to those who define pitch as height, 
and who must therefore deny that "pitch is to the musician what 
color is to the artist — his medium of expression." 

Cornell University. R. M. Ogden. 

J. W. Bridges. An Outline of Abnormal Psychology. R. G. Adams & 
Co., Columbus, Ohio, 1919, p. 127. 

This book is intended to be useful to "those medical students and 
students of social service who desire a general survey of this field but 
who have insufHcient time for a regtdar supervised course or for 
extensive reading of the very much scattered literature." It is also 
"to serve as a guide for students of abnormal psychology in the 
absence of a comprehensive text-book." 

The book is found, however, to be more than a mere guidebook. For 
example, in the second part, on mental diseases, a concise and carefully 
arranged table of symptoms is given under the discussion of each type 
of insanity. The name, " An Outline of Abnormal Psychology " may 
be taken literally: the book is written actually in outline form. The 
first part deals with abnormal phenomena in general. Under definitions 
and classification, Wernicke's classification only is given. This, 
however, is not held to in the author's discussion of the subject, which 
begins with sensation, goes on through consciousness and attention, 
memory, association, judgment, orientation feeling and temperament, 
to instinct and emotion, innate action, and acquired action, much in the 
manner of the ordinary text-book of normal psychology. The section 
ends with chapters on intelligence, personality, and sleep, dreams, and 
hypnosis. Each chapter contains a full list of all possible abnormalities 
in the different manifestations of mind, together with their technical 
nomenclature. Under intelligence, the most generally used metiiods 
of measuring intelligence are mentioned. The second part is on mental 
disease. Feeble-mindedness, usually given at least a chapter in a 
work on abnormal psychology, is not treated here, except as one kind 
(cretinism) finds a place under thyroigenous psychoses. All the other 
varying forms, such as mongolianism, and microcephalis which certainly 
ought to be described in a book on abnormal psychology, (at least if 
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that term is taken in its broadest sense to mean not-normal psychol- 
ogy) are not even mentioned but are summarily dismissed when the 
author distinguishes between amentia or feeble-mindedness, and 
dementia, explaining that ''The former is an innate defect, while the 
latter is the result of a mental deterioration." No general classifica- 
tions of the psychoses are given, except the author's own, as implied 
by his chapter headings, which run as follows: Dementia Precox, 
(Paraphrenia, Paranoia), Manic-Depressive Insanity, Dementia Paraly- 
tica, The Alcoholic Psychoses, Morphine, Cocaine, and Other Drugs, 
The Presenile and Senile PwJioses, and The Symptomatic Psychoses. 
But in the third part, on Borderline Diseases, Freud's, Sidis's, and 
Kraepelin's classifications of the neuroses are presented. 

Throughout the work impartial consideration is given to many and 
widely differing theories of the various phases of abnormal psychology. 
Copious references are to be found after each chapter. One wishes 
that a comprehensive index might also have been given a place. 

This outline will probably be of greater assistance to those already 
fairly familiar with the subject, but who need help in clarifying and 
systematizing their knowledge, than to those who, by the reading of 
this book alone, would gain their whole information. The work is at 
once too technical and too abbreviated to be very meaningful to the 
average lajrmen. Mabjory Bates. 

Gark University. 

Caktkk Alexander. School Statistics and Publicity. Silver, Burdett 
& Co., New York, 1919, p. xix+332. 

This little book is an outgrowth of the author's teaching at the 
Peabody College for Teachers. It is produced with the avowed aim of 
aiding active superintendents of schools to adequately place before the 
public such statistics as show school needs and school achievements. 
It is also intended for use as a textbook by those who are "engaged 
in training future superintendents." Its clear, simple style and the 
abundance of illustrative material make it very serviceable for either 
purpose, and as a textbook its value is enhanced by the suggestions to 
instructors and by the exercises which follow each chapter. 

The book falls rather readily into three main divisions. The first 
of these, consisting of the first three chapters is largely introductory 
in value. The author points out in the first chapter the various types 
of errors and deficiencies commonly noted when good but unthinking men 
are tempted to use figures. The second chapter very practically tells 
how to collect data, and the third is an argument for knowledge of the 
technique of statistics on the part of school administrators. 

There can be no doubt in the mind of the reader after reading these 
three chapters that the author thoroughly believes in statistical, or at 
least graphic presentation of school facts to the public. At the same 
time he takes a very moderate stand on the question of the amount of 
statistical knowledge that is practically necessary. 

The second division, consisting of chapters four to eight inclusive, 
affords a very clear elementary presentation of statistical method. The 
fifth, sixth and seventh chapters are the most difficult in the book and 
the author admits that they will require little more careful study than 
the others, but despite this admission it would be hard to find a 
clearer or simpler exposition of the matters treated. Chapters six and 
seven, treating of measures of deviation and of relationship, are the 
most technical, and it is possible that in a majority of cases the busy 
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tuperintendent coald omit them without serious low so far as their 
▼aiue in connection with his local ptd>lic is concerned. If he is to take 
his work very seriously, however, they are very needful in order that 
he may be able to interpret his data completely. 

The remaining four chapters, forming the third division, present 
devices for making clear and strfldng presentations of data. Tliese 
devices are well chosen, not only by reason of their effectiveness but 
also because of their ingenious use of materials and tools ready at hand 
even in a poorly equipped office. This practicality is furdier evidenced 
by the author's statement that all but five of the seventy-nine cuts in 
the book were nuide by high school boys, — a demonstration of the 
possibilities of student assistance to the superintendent 

An annotated bibliography is given, consistent in tjrpe with the rest 
of the book, its chief features being its freedom from cumbrousness and 
its choice, in the main, of readily accessible material. 

Clark University. Geo. Allkn Cob. 

WnxiAM H. DooLBY. Principles and Methods of Industrie Education 
For Use in Teacher Training Classes. With an Introduction by 
Charles A. Prosser) Houghton Mifflin Company, Boston, 1919, p. 
257. 

Probably no educational scheme or problem is more in the public eye 
than that of vocational or industrial education. The paucity of skilled 
help in neariy all industries is such that the problem of present supirfy 
is a most perplexing and serious one. Dr. rrosser sums up the situa- 
tion in his Introduction to this book : " Never in our history has there 
been such a keen realization of the dependence of production upon 
skill, and the part that wise methods of training have in cultivating 
skill. In our ways and means for meeting these increasing demands 
we are at once fortunate and unfortunate; fortunate in adequate 
financial support for sound instructor training plans ; unfortunate in a 
shortage of people to organize and direct them, and doubly unforttmate 
in a lack of organized practical material for use m instructor (teacher) 
training classes." 

This book, as a whole, goes far to fill the place which Dr. Prosser 
notes above, and is an admirable compilation of contemporary writers 
and bulletins, and is drawn without stint from any source that seemed 
to furnish the material for the purpose in mind. 

It has been difficult for the vocational teacher-training personnel to 
get away from the academic point of view, and the sporadic efforts of 
ttie past and even of the present, lean too far away from practical shop 
sense to meet the need o( the industries for practical, not thoretical, 
men. The author has seemingly been fortunate to sense this most 
important error and has arranged his book in orderly fashion, and 
clothed it in understandable language that easily makes interestmg 
many of the dry details of pedagogy which are essential for the well- 
trained trade teacher. 

The book deals widi die following topics: the Value of Industrial 
Education, the Educational Needs of Trades and Industries, How men 
have been trained for Trades and Industries in the Past, Different 
Tvpes of Industrial Sdiools, Organization of Industrial Schools and 
of Industrial Classes, an Industrial Survey, Principles of Psychology 
underlying Learning, General Methods of Teaching, General Methods 
for Teaching in Industrial Education, Methods of Teaching Shop 
Work, of Interpretation of Blue Prints and Shop Sketching, of Shop 
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Science, of Shop or Industrial Mathematics and of English and Manual 
Training compared with Industrial Education. 

A valuable feature of the book is the list of " Questions for Discus- 
sion " that is given at the end of each chapter. This is followed by 
a " List of References for Further Reading." There is also an Appendix 
of forty-seven pages giving typical outlines and suggestive courses of 
study in various kinds of vocational schools. 

Taken as a whole, the work should prove valuable to the trade 
instructor and especially to those engaged in teacher-training for 
vocational schools. 

Clark University. Haksy E. Miluken. 
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NOTES 

The Carnegie Corporation of New York has announced its purpose 
to give ^,000,000 for the use of the National Academy of Sciences and 
the National Research Council. It is understood that a portion of the 
money will be used to erect in Washington a home of suitable archi- 
tectural dignity for the two beneficiary organizations. The remainder 
will be placed in the hands of the Academy, which enjoys a federal 
charter, to be used as a permanent endowment for the National 
Research Council. This impressive gift is a fitting supplement to Mr. 
Carnegie's great contributions to science and industry. 

The Council is a democratic organization based upon some forty of 
the great scientific and engineermg societies of the country, which 
elect delegates to its constitutent Divisions. It is not supported or 
controlled by the government, differing in this respect from other 
similar organizations established since the beginning of the war in 
England, Italy, Japan, Canada, and Australia. It intends, if possible to 
achieve in a democracy and by democratic methods the great scientific 
results which the Germans achieved by autocratic methods in an 
autocracy while avoiding the obnoxious features of the autocratic 
regime. 

The Council was organized in 1916 as a measure of national prepar- 
edness and its efforts during the war were mostly confined to assisting 
the government in the solution of pressing war-time problems involving 
scientific investigation. Reorganized since the war on a peace-time 
footing, it is now attempting to stimulate and promote scientific 
research in agriculture, medicine, and industry, and in every field of 
pure science. The war afforded a convincing demonstration of the 
dependence of modem nations upon scientific achievement, and nothing 
is more certain than that the United States will ultimately fail behind 
in its competition with the other great peoples of the world unless 
there be persistent and energetic effort expended to foster scientific 
discovery. 

The Commissioner of Institutions and Agencies of New Jersey, 
Burdette G. Lewis, has recently extended the scope of the State 
Psychiatric Oinic to include psychological work in the correctional 
institutions of New Jersey. The work is at present organized as a 
section of the Psychiatric Qinic of the New Jersey State Hospital for 
the Insane, Dr. Henry A. Cotton, Director. Mr. Edgar A. Doll was 
appointed as the Department Psychologist in July. 1919, following a 
period of preliminary investigation concerning the application of 
psychological methods in correctional institutions. In August, 1919, 
Mr. W. J. Ellis was appointed assistant psychologist. The psychologi- 
cal staff also includes 2 volunteer assistants, Mr. Warren S. Prince and 
Miss Anna Gillingham. The psychological work in the correctional 
institutions of New Jersey is directly related to the classification and 
marking system recently installed as a basis for parole under the 
Division of Education and Parole of the Department of Institutions 
and Agencies, Calvin Derrick, Director. The functions of the 
psychological work are to make mental diagnoses of the inmates of 
correctional institutions and on the basis of psychological tests and 

112 
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measurements to recommend concerning the educatiotial, vocational, 
disciplinary and parole treatment of delinquents and prisoners. The 
Army group test Alpha, supplemented by individual examinations, 
has been in use since February, 1919, and surveys of the four principal 
institutions have been made. Clinical psychological methods to supple- 
ment the group tests have been installed in tiie New Jersey State 
Prison, at the State Home for Boys at Jamesburg, and at the State 
Home for Girls at Trenton. Psychological analyses of industrial and 
vocational activities of the institutions are in process at the State 
Prison and at the State Home for Boys. It is expected that if the 
work continues to develop the StaflF of the Psychological Section will 
be expanded as needs demand. 

The present program of psychological examining at the New Jersey 
State Prison includes an attempt to introduce scientific management in 
the problems of industrial and vocational assignments of prisoners. 
The purpose of this program is (1) to improve the possibilities of 
utilizing to the best advantage the reformatory influences which the 
Prison provides, (2) to improve the morale or mental attitude of the 
prisoners by having them assigned to work which is suited to their 
capabilities and best interests, (3) to improve the efficiency of instruc- 
tion in the vocational shops, and (4) to increase the effectiveness of 
the routine work in the Prison shops. 

To accomplish these ends the psychological section of the Psychiatric 
Ginic has instituted at the request of the Commissioner and the 
Director of the Division of Education and Parole, a psychological and 
industrial analysis of the Prison activities both vocational and indus- 
trial. This analysis is intended to form the basis of intelligent 
assignment of men to shops or tasks. The regular work of the 
Ps3rchologist calls for individual analysis of each prisoner with respect 
to his general intelligence, mental responsibility, vocational aptitudes, 
and industrial qualifications. It is the hope of the Department to effect 
the coordination of this man-analysis and job-analysis in such a way 
that, knowing the capabilities of the man and the requirements of the 
job the welfare of the prisoners and their efficiency in their tasks may 
be materially advanced. 

Job-analysis. The Assistant Psychologist aided by a graduate 
student in psychology has conducted psychological and vocational 
analyses of numerous ' jobs ' in the Prison. The results of this inves- 
tigation cannot yet be presented in full but the results for two jobs may be 
cited briefly. The Assistant Psychologrist finds that the print shop, for 
example, is a highly specialized mdustry, calling for particular 
degrees of skill which are ordinarily attained only after long practice. 
The print shop also presents an industry whose various operations are 
highly di£Ferentiated with respect to the gradation of processes in the 
industry. The Psychologist, therefore, has found very clear depend- 
ence of success upon general intelligence and general education in the 
succession of tasks in the print shop. It is, tnerefore,, comparatively 
easy to predict a man's degree of success in learning this industry 
simply on the basis of his general intelligence and general education. 
In addition it is possible in the print shop to measure the degree of 
specific aptitude and skill which men must possess for immediate 
success in the work of the shop. It is easily possible to apply mental 
tests such as alphabet sorting and visual discrimination, and tests of 
special forms of fatigue which would be applicable to die assignment 
of men to work in the print shop. 
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Contrasted with the print shop we may cite briefly the results 
obtained in the shoe shop. In this shop the succession of tasks is not 
very sharply differentiated on the basis of general intelligence. The 
general level of intelligence in the shoe shop ranges from a minimum 
of mental age 11 years to a maximum mental age of about 14 years. 
The overlapping of intelligence from operation to operation is very 
great. Moreover, the educational requirements are practically negligi- 
ble. Therefore, in the shoe shop it is difficult to assign a man to a partic- 
ular task on the basis of his general intelligence or education. In the 
print shop, by contrast, the range of intelligence was from his minimum 
mental age of 11 years to a maximum mental age of 18 years. The 
succession of operations within that shop were found to be very 
clearly operated on the basis of general intelligence. In the shoe shop 
as in the print shop it is possible to devise tests of specific aptitude for 
the several operations demanded. A cutter, for example, must be able 
to cut up a piece of leather with a minimum of waste. A psychological 
test of form perc^tion analogous to the jig-saw puzzle might be used 
for testing this ability. As yet the psychologist has not proceeded far 
enough with his work to devise the tests needed for such work. He is, 
however, at work on this problem. 

Man-analysis. Each prisoner is examined by the psychologist almost 
immediately after his admission to the Prison. The purpose of this 
examination is to determine general intelligence, character or person- 
ality make up, actual degree of education and potential educability, 
actual degree of industrial skill and potential vocational aptitudes. 
The pS3rchological and educational tests are relatively well developed. 
It is therefore easy enough to measure a man's general intelligence, 
education and degree of educability with a high degree of accuracy. 
Trade and vocational tests, however, are not yet stifficiently developed 
for immediate use at the Prison. Those tests for measuring industrial 
capability and vocational aptitudes which are now available in psychol- 
ogy are not specifically suited to the needs of the work at the Prison. 
It is therefore necessary to devise special tests of this character speci- 
fically suited to the present Prison conditions. It is planned to obtain the 
industrial history of each man and then to quiz him carefully regarding 
his present decree of skill in the major trades which he claims to have 
followed. It IS also planned to examine him with vocational tests to 
determine his industrial aptitudes. He will also be questioned concern- 
ing his own ambitions and the industrial possibilities in the environ- 
ment to which he expects to go when released. 

Coordination of Joh-analysis and Man-analysis, Specification cards 
will be designed for all the detailed jobs in the Prison and similar cards 
will be designed to summarize all the information obtainable regarding 
each man. These cards will call for the physical, mental, educational 
and industrial requirements of the job and the similar abilities of the 
man. It will then be possible, knowing the requirements of the job 
and the capabilities of the man, to assign a man to a job on a scientific 
basis. It is, of course, unlikely that this reUtively ideal program can 
be achieved within the course of at least another year, but some 
actual progress is already being made. The assigning officer at the 
Prison is already using the results of the psychological examining in 
such a way as to enable him to place men more successfully than 
heretofore. The general conduct of the work involved in carrying out 
this program is also definitely bringing to consciousness among the 
Prison officials both the needs and the possibilities for more efficient 
classification and placement. 
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JOUENAL OF APPLIED PSYCHOLOGY 

Vol. IV JUNE-SEPTEMBER, 1920 Noe. 2 and 3 

TABLES TO FACILITATE THE COMPUTATION OP 

COEFFICIENTS OF CORRELATION BY THE 

RANK DIFFERENCE METHOD* 

These tables have been prepared to facilitate the computation 
of the coefficient of correlation by the rank difference method. 

Correlation coefficients based on ranks are necessarily used when 
the variables to be correlated are expressed in ranks. Certain 
writers have failed to see that in such cases a coefficient based on 
ranks in the variables is just as significant as one based on measure- 
ments. When the interest is in relative position the rank difference 
correlation coefficient should not be converted into r; p gives the 
actual relationship in terms of relative position. 

Computation of correlation coefficients by the rank difference 
method is frequently useful even when original measurements 
must first be transformed into ranks. If the relation is not desired 
in terms of relative position, the rank correlation coefficient may 
be converted into r by means of the table on page 125, provided the 
original distribution can be considered approxintiately normal. 

There is an impression that the rank formula is an approxima- 
tion. This is not true. The formula 

62D» 2(xy) 

/> = 1 is derived directly from r = and 

n(n« — 1) N<r, <ry 

corresponds exactly with the product moment correlation co- 
efficient. 

These tables will be foimd useful in eliminating some of the 
drudgery of computation in scientific laboratories and in classroom 
work in statistics, psychology, and the other sciences which make 
use of correlation statistics. Industry will also find in these 
tables a short cut to the determination of many important re- 
lationships. This is especially true of work carried on in 
emplojnnent departments. 

THE SCOTT COMPANY LABORATORY. 
Philadelphia, Pa. 
March 1, 1920. 

•Reprints of this article with the Tables may be obtained from the Journal 
Applied Psychology, Orders should be addr^sed to Miss Florence Chandler, 
University, Worcester, Mass. 
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INSTRUCTIONS FOR CALCULATING RANK DIFFERENT: COEFFI- 
CIENTS WITH THE USE OF TABLES* 

1. Arrange each of the two series of measurements to be cor- 
related in rank order. Every pair of measurements is thus 
represented by a pair of ranks — the relative positions assigned 
those measurements in the two series. 

2 . Obtain the difference between the two ranks assigned each case. 

3. Square each of these differences. The squares are read from 
the Table, Page 117. Note that the decimals maybe omitted from 
the squares without appreciable error. 

4. Add these squares of the differences. This stun (2D*) is to 
be foimd in the body of the Tables, Pages 118 to 125. 

5. Refer in the Tables to the proper coliunn for the ntunber of 
cases used (N). Thus, if 21 cases were ranked, use the second 
column on Page 119. Run down this column until you find the entry 
nearest the obtained 2D'. 

6. Read the entry in this same line at either side of the page (first 
or last column) . This entry is />, the desired coefficient of oorrdation. 

Example: 21 cases are arranged in rank order 
for two variables; the sum of me squares of the 
differences in the corresponding ranks is found 
to be 531 (five-tenths is disregarded). 

Refer to the second column on Page 119, run 
down to the entry which most nearly eouals 531, 
that is 524 and read beside it the coefficient of 
correlation, .66. 

Note: (a) If the obtained 2D* is nearly mid- 
way between two entries, use the p falling between 
the p's corresponding to the two entries. (If 
the 2D' in the examine were 540, p would be 
.65.) Correlation coefficients accurate to .01 
can be read almost instantly. Closer inter- 
polation is useless. 

(b) For 2D* greater than those corresponding 
to /9 = (i. e. in case of negative correlation} 
subtract the obtained 2D* from the entry in that 
column corresponding to p = — 1.00. Find the 
p correspondmg to this number obtained by 
subtraction. With a negative sign prefixed, 
this is the desired p. 

^iy=« 531. 5 

♦For a complete discussion of the rank difference method of computing corre- 
lation coefficients, see H. O. Rugg, " Statistical Methods Applied to Education," 
P. 283 ff., Houghton Mifflin Co., New York; E. L. Thomdike. " Introduction to 
the Theory of Mental and Social Measurements," P. 24 ff, P. 157 ff, Teachers 
College, Columbia University, New York; Wm. Stem, " Psychological Methods 
of Testing Intelligence," P. 109 ff, Warwick & York, Baltimore, Md. 
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SQUARES OF DIFFERENCES 
Ftom to 80 by Halves 



tfereoce 

.5 

1 
1.5 


Square of 



.25 
1.00 
2.25 


Differenre 
20 
20.5 
21 
21.5 


Square of 
difference 
400.00 
420.25 
441.00 
462.25 


Difference 
40 
40.5 
41 
41.5 


Square of 
difference 
1600.00 
1640.25 
1681.00 
1722.25 


Difference 
60 
60.5 
61 
61.5 


Square (rf 

3600.00 
3660.25 
3721.00 
37B2.25 


2 

2.5 
3 
3.5 


4.00 

6.25 

9.00 

12.25 


22 
22.5 
23 
23.5 


484.00 
506.25 
529.00 
552.25 


42 
42.5 
43 
43.5 


1764.00 
1806.25 
1849.00 
1892.25 


62 
62.5 
63 
63.5 


3844.00 
3906.25 
3969.00 
4032.25 
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4.5 
5 
5.5 


16.00 
20.25 
25.00 
30.25 


24 
24.5 
25 
25.5 


576.00 
600.25 
625.00 
660.25 


44 

44.5 
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45.5 


1936.00 
1980.25 
2025.00 
2070.25 


64 

64.5 
65 
65.5 


4096.00 
4160.25 
4225.00 
4290.25 


6 

6.5 
7 
7.5 


36.00 
42.25 
49.00 
56.25 


26 
26.5 
27 
27.5 


676.00 
702.25 
729.00 
756.25 


46 
46.5 
47 
47.5 


2116.00 
2162.25 
2209.00 
2256.25 


66 
66.5 
67 
67.5 


4356.00 
4422.25 
4489.00 
4556.25 


8 

8.5 
9 
9.5 


64.00 
72.25 
81.00 
90.25 


28 

28.5. 
29 
29.5 


784.00 
812.25 
841.00 
870.25 


48 
48.5 
49 
49.5 


2304.00 
2352.25 
2401.00 
2450.25 


68 
68.5 
69 
69.5 


4624.00 
4692.25 
4761.00 
4830.25 


10 

10.5 
11 
11.5 


100.00 
110.25 
121.00 
132.25^ 


30 
30.5 
31 
31.5 


900.00 
930.25 
961.00 
992.25 


50 
50.5 
51 
51.5 


2500.00 
2550.25 
2601.00 
2652.25 


70 
70.5 
71 
71.5 


4900.00 
4970.25 
5041.00 
5112.25 


12 

12.5 
13 
13.5 


144.00 
156.25 
169.00 
182.25 


32 
32.5 
33 
33.5 


1024.00 
1056.25 
1089.00 
1122.25 


52 
52.5 
53 
53.5 


2704.00 
2756.25 
2809.00 
2862.25 


72 
72.5 
73 
73.5 


5184.00 
5256.25 
5329.00 
5402.25 


14 

14.5 
15 
15.5 


196.00 
210.25 
225.00 
240.25 


34 
34.5 
35 
35.5 


1156.00 
1190.25 
1225.00 
1260.25 


54 
54.5 
55 
55.5 


2916.00 
2970.25 
3025.00 
3080.25 


74 

74.5 
75 
75.5 


5476.00 
5550.25 
5625.00 
5700.25 


16 

16.5 
17 
17.5 


256.00 
272.25 
289.00 
306.25 


36 
36.5 
37 
37.5 


1296.00 
1332.25 
1369.00 
1406.25 


56 
56.5 
57 
57.5 


3136.00 
3192.25 
3249.00 
3306.25 


76 
76.5 
77 
77.5 


5776.00 
5852.25 
5929.00 
6006.25 



18 324.00 38 1444.00 58 3364.00 78 6084.00 
18.5 342.25 38.5 1482.25 58.5 3422.25 78.5 6162.25 

19 361.00 39 1521.00 59 3481.00 79 6241.00 
19.5 380.25 39.5 1560.25 59.5 3540.25 79.5 6320.25 

Dedmals mav be entirely disregarded without appreciably affecting the resulting correlation 
oefficients. The error is never greater than .02, and is usually much less. 
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.16 


185 


240 


306 


382 


470 


571 


685 


814 


958 


1117 


.14 


189 


246 


313 


391 


482 


585 


702 


833 


980 


1144 


.14 
.12 


.12 


194 


252 


320 


400 


493 


598 


718 


853 


1003 


1170 


.10 


198 


257 


328 


410 


504 


612 


734 


872 


1026 


1197 


.10 


.08 


202 


263 


335 


419 


515 


626 


751 


891 


1049 


1224 


.08 
.06 


.06 


207 


269 


342 


428 


526 


639 


767 


911 


1072 


1250 


.04 


211 


275 


349 


437 


538 


653 


783 


930 


1094 


1277 


.04 


.02 


216 


280 


357 


446 


549 


666 


800 


950 


1117 


1303 


.02 


.00 


220 


286 


364 


455 


560 


680 


816 


969 


1140 


1330 


.00 


■1.00 


440 


572 


728 


910 


1120 


1360 


1632 iti. 


am^. 


^JSefLi 


2660 


-1.00 



COMPUTATION OF CX)EFFICIENTS OF CX)RRELATION 119 
NUMBER OF CASES RANKED 



p 


21 


22 


23 


24 


25 


26 


27 


28 


29 


30 


P 


1.00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


1.00 


.98 


31 


35 


40 


46 


52 


59 


66 


73 


81 


90 


.98 


.96 


62 


71 


81 


92 


104 


117 


131 


146 


162 


180 


.66 


.94 


92 


106 


121 


138 


156 


176 


197 


219 


244 


270 


.94 


.92 


123 


142 


162 


184 


208 


234 


262 


292 


325 


360 


.92 


.90 


154 


177 


202 


230 


260 


. 293 


328 


365 


406 


450 


.90 


.88 


185 


213 


243 


276 


312 


351 


393 


438 


487 


539 


.88 


.86 


216 


248 


»« 


322 


364 


410 


459 


512 


568 


629 


.86 


.84 


246 


283 


324 


368 


416 


468 


524 


585 


650 


719 


.84 


.82 


277 


319 


364 


414 


468 


527 


590 


658 


731 


809 


.82 


.80 


308 


354 


405 


460 


520 


585 


655 


731 


812 


899 


.80 


.78 


339 


390 


445 


506 


572 


644 


721 


804 


893 


«l09 


.78 


.76 


370 


425 


486 


552 


624 


702 


786 


877 


974 


1079 


.76 


.74 


400 


460 


526 


598 


676 


761 


852 


950 


1056 


1169 


.74 


.72 


431 


496 


567 


644 


728 


819 


917 


1023 


1137 


1259 


.72 


.70 


462 


531 


607 


690 


780 


878 


983 


1096 


1218 


1349 


.70 


.68 


493 


567 


648 


736 


832 


936 


1048 


1169 


1299 


1438 


.68 


.66 


524 


602 


688 


782 


884 


995 


1114 


1242 


1380 


1528 


.66 


.64 


554 


638 


729 


828 


936 


1053 


1179 


1315 


1462 


1618 


.64 


.62 


585 


673 


769 


874 


988 


1112 


1245 


1389 


1543 


1708 


.62 


.60 


616 


708 


810 


920 


1040 


1170 


1310 


1462 


1624 


1798 


.60 


.58 


647 


744 


850 


966 


1092 


1229 


1376 


1535 


1705 


1888 


.58 


.56 


678 


779 


891 


1012 


1144 


1287 


1441 


1608 


1786 


1978 


.56 


.54 


708 


815 


931 


1058 


1196 


1346 


1507 


1681 


1868 


2068 


.54 


.52 


739 


850 


972 


1104 


1248 


1404 


1572 


1754 


1949 


2158 


.52 


.50 


770 


886 


1012 


1150 


1300 


1463 


1638 


1827 


2030 


2248 


.50 


.48 


801 


921 


1052 


1196 


1352 


1521 


1704 


1900 


2111 


2337 


.48 


.46 


832 


956 


1093 


1242 


1404 


1580 


1769 


1973 


2192 


2427 


.46 


.44 


862 


992 


1133 


1288 


1456 


1638 


1835 


2046 


2274 


2517 


.44 


.42 


893 


1027 


1174 


1334 


1508 


1697 


1900 


2119 


2355 


2607 


.42 


.40 


924 


1063 


1214 


1380 


1560 


1755 


1966 


2192 


2436 


2697 


.40 


.38 


955 


1098 


1255 


1426 


1612 


1814 


2031 


2265 


2517 


2787 


.38 


.36 


986 


1133 


1295 


1472 


1664 


1872 


2097 


2338 


2598 


2877 


.36 


.34 


1016 


1169 


1336 


1518 


1716 


1931 


2162 


2412 


2680 


2967 


.34 


.32 


1047 


1204 


1376 


1564 


1768 


1989 


2228 


2485 


2761 


3057 


.32 


.30 


1078 


1240 


1417 


1610 


1820 


2048 


2293 


25C8 


2842 


3147 


.30 


.28 


1109 


1275 


1457 


1656 


1872 


2106 


23Sh 


2631 


2923 


3236 


.28 


.26 


1140 


1311 


1498 


1702 


1924 


2165 


TATA 


2704 


3004 


3326 


.26 


.24 


1170 


1346 


1538 


1748 


1976 


2223 


2490 


2777 


3086 


3416 


.24 


.22 


1201 


1381 


1579 


1794 


2028 


2282 


2555 


2850 


3167 


3506 


.22 


.20 


1232 


1417 


1619 


1840 


2080 


2340 


2621 


2923 


3248 


3596 


.20 


.18 


1263 


1452 


1660 


1886 


2132 


2399 


2686 


2996 


3329 


3686 


.18 


.16 


1294 


1488 


1700 


1932 


2184 


2457 


2752 


3069 


3410 


3776 


.16 


.14 


1324 


1523 


1741 


1978 


2236 


2516 


2817 


3142 


3492 


3866 


.14 


.12 


1355 


1558 


1781 


2024 


2288 


2574 


2883 


3216 


3573 


3956 


.12 


.10 


1386 


1594 


1822 


2070 


2340 


2633 


2948 


3289 


3654 


4046 


.10 


.08 


1417 


1629 


1862 


2116 


2392 


2691 


3014 


3362 


3735 


4135 


.08 


.06 


1448 


1665 


1903 


2162 


2444 


2750 


3079 


3435 


3816 


4225 


.06 


.04 


1478 


1700 


1943 


2208 


2496 


2808 


3145 


3508 


3898 


4315 


.04 


.02 


1509 


1736 


1984 


2254 


2548 


2867 


3210 


3581 


3979 


4405 


.02 


.00 


1540 


1771 


2024 


2300 


2600 


2925 


3276 


3654 


4060 


4495 


.00 



3080 3542 4048 4600 5200 5850 6552 7308 8120 8990 —1.00 



120 THE SCOTT CX)MPANY LABORATORY 

NUMBER OF CASES RANTCE:r> 



31 


32 


33 


34 


35 


36 


3r 


00 


00 


00 


00 


00 


00 


c»o 


99 


109 


120 


131 


143 


155 


169 


198 


218 


239 


262 


286 


311 


33r 


296 


327 


359 


393 


428 


466 


SOB 


397 


436 


479 


524 


571 


622 


ers 


496 


546 


596 


655 


714 


777 


844 


595 


665 


718 


785 


857 


932 


1012 


694 


764 


838 


916 


1000 


1068 


1181 


794 


873 


957 


1047 


1142 


1243 


13SO 


893 


982 


1077 


1178 


1285 


1399 


1518 



38 


39 


40 


OO 


00 


00 


183 


198 


213 


366 


395 


426 


548 


S93 


640 


731 


790 


853 


914 


968 


1066 


1097 


1186 


1279 


X279 


1383 


1492 


1462 


1581 


1706 


1645 


177B 


1919 



.80 992 1091 1197 1309 1428 1554 1687 i^s^oa iq7<; 21^2 

.78 1091 1200 1316 1440 1571 1709 185e ^Ti 9i7i 2a^ 

.76 1190 1309 1436 1571 1714 1865 2025 ^o^ wi ^ 

.74 1290 1419 1556 1702 1856 2020 21^3 ^^ ^ OT2 

.72 1389 1528 1676 1833 1999 2176 2362 ^^ PI 29^ 

.70 1488 1637 1795 1964 2142 2331 253X ^-y^o oqai -qi<» 

.68 1587 1746 1915 2094 2285 2486 270O ^o5 S?S ^ 

.66 1686 1855 2035 2225 2428 2642 2868 ^?S^ SSS ^oa 

.64 1786 1964 2154 2356 2570 2797 3037 ^ooA ^S? ^ 

.62 1885 2073 2274 2487 2713 2953 3206 3473 ^ ^ 

1984 2182 2394 2618 2856 3108 3374 -:^^tz^ ooro lOfii 

2083 2292 2513 2749 2999 3263 3543 ^^S§Z ^ ^ 

2182 2401 2633 2880 3142 3419 3712 I^^? fi52 tSA 

2282 2510 2753 3011 3284 3574 388X 2S^1 ^l ^ 

2381 2619 2872 3142 3427 3730 404Q 4387 ^ 5117 

2480 2728 2992 3273 3570 3885 4218 ^rr.,^ .^.a cqoa 

2579 2837 3112 3403 3713 4040 4387 1t^79 ^ S?S 

2678 2946 3231 3534 3856 4196 4555 ^A5? SS? Sg 

2778 3055 3351 3665 3998 4351 4724 Sr?5 ^ !SS 

2877 3164 3471 3796 4141 4507 4893 S3oi ^ 61S 

2976 3274 3590 3927 4284 4662 5062 r=:^_ .^on^ 

3075 3383 3710 4058 4427 4817 5230 ^^5^ 5928 ^ 

3174 3492 3830 4189 4570 4973 539d ^§^6 6126 fgg 

3274 3601 3949 4320 4712 5128 556B ^S^9 6323 ^ 

3373 3710 4069 4451 4855 5284 573S ^9^2 6521 7036 

• «^15 6718 7249 

3472 3819 4189 4582 4998 5439 5905 ^=.*^_ _ 

3571 3928 4308 4712 5141 5594 6074 ^^^7 6916 74g 

3670 4037 4428 4843 5284 5750 6243 ^§^0 7114 TS^ 

3770 4147 4548 4974 5426 5905 6411 SX^3 7311 7888 

3869 4256 4668 5105 5569 6061 6580 S^4« 7509 81(^ 

~^28 7706 8315 

3968 4365 4787 5236 5712 6216 6749 ^,^ 

4067 4474 4907 5367 5855 6371 6918 Z^H 7904 8528 

4166 4583 5027 5498 5998 6527 7086 Z^d4 8102 8741 

4266 4692 5146 5629 6140 6682 7255 Z!^'^^ 8299 8954 

4365 4801 5266 5760 6283 6838 7424 ^^ 8^ 9168 

^042 QffiA 9381 

4464 4910 5386 5891 6426 6993 7592 ^ 

4563 5020 5505 6021 6569 7148 7761 S^35 M»2 9594 

4662 5129 5625 6152 6712 7304 7930 ^"^Oe o^ 9607 

4762 5238 5745 6283 6854 7459 8099 S^<9l q^ 10020 

4861 5347 5864 6414 6997 7615 8267 §?73 ^ 10234 

4960 5456 5984 6545 7140 7770 8436 ^^56 q^ 10447 

^13^ QMO 10660 

9920 10912 11968 13090 14280 15540 16872 ^^^ 



^^^7% ,Q7fiO 21320 -1-^ 



CX:)MPUTATION OF CX)EFFICIENTS OF CX)RRELATION 121 



41 
00 
230 
459 
689 
918 

1148 
1378 
1607 
1837 
2066 

2296 
2526 
2755 
2985 
3214 

3444 
3674 
3903 
4133 
4362 

4592 
4822 
5051 
5281 
5510 

5740 
5970 
6199 
6429 
6658 



NUMBER OF CASES RANKED 



7118 
7347 
7577 
7806 

8036 
8266 
8495 
8725 
8954 

9184 
9414 
9643 
9873 



42 
00 
247 
494 
740 
987 

1234 
1481 
1728 
1975 
2221 

2468 
2715 
2962 
3209 
3455 

3702 
3949 
4196 
4443 
4690 

4936 
5183 
5430 
5677 
5924 

6171 
6417 
6664 
6911 
7158 

7405 
7651 
7898 
8145 
8392 



43 

00 

265 

530 

795 



44 

00 

284 

568 

851 



45 

00 

304 

607 

911 



46 

00 

324 

649 



47 

00 

346 

692 



973 1038 



48 

00 

368 

737 

1105 



1060 1135 1214 1297 1384 1474 



1324 
1589 
1854 
2119 
2384 

2649 
2914 
3179 
3443 
3708 

3973 
4238 
4503 
4768 
5033 

5298 
5562 
5827 
6092 
6357 

6622 
6887 
7152 
7417 
7682 

7946 
8211 
8476 
8741 
9006 



1419 
1703 
1987 
2270 
2554 

2838 
3122 
3406 
3689 
3973 

4257 
4541 
4825 
5108 
5392 

5676 
5960 
6244 
6527 
6811 



1518 
1822 
2125 
2429 
2732 

3036 
3340 
3643 
3947 
4250 

4554 
4858 
5161 
5465 
5768 

6072 
6376 
6679 
6983 
7286 



7095 7590 

7379 7894 

7663 8197 

7946 8501 

8230 8804 

8514 9108 

8798 9412 

9082 9715 

9365 10019 

9649 10322 



8639 9271 9933 10626 

8886 9536 10217 10930 

9132 9801 10501 11233 

9379 10065 10784 11537 

9626 10330 11068 11840 

9873 10595 11352 12144 

10120 10860 11636 12448 

10366 11125 11920 12751 

10613 11390 12203 13055 

10860 11655 12487 13358 



1622 
1946 
2270 
2594 
2919 

3243 
3567 
3892 
4216 
4540 

4865 
5189 
5513 
5837 
6162 

6486 
6810 
7135 
7459 
7783 

8108 
8432 
8756 
9060 
9405 

9729 
10053 
10378 
10702 
11026 

11351 
11675 
11999 
12323 
12648 

12972 
13296 
13621 
13945 
14269 



1730 
2076 
2421 
2767 
3113 

3459 
3805 
4151 
4497 
4843 

5189 
5535 
5881 
6227 
6572 

6918 
7264 
7610 
7956 
8302 

8648 
8994 
9340 
9686 
10032 

10378 
10724 
11069 
11415 
11761 



1842 
2211 
2579 
2948 
3316 

3685 
4053 
4422 
4790 
5159 

5527 
5896 
6264 
6633 
7001 

7370 
7738 
8107 
8475 
8844 

9212 

9580 

9949 

10317 

10686 

11054 
11423 
11791 
12160 
12528 



49 

00 

392 

784 

1176 

1568 

1960 
2352 
2744 
3136 
3528 

3920 
4312 
4704 
5096 
5488 



50 

00 

417 

833 

1250 

1666 

2063 
2499 
2916 
3332 
3749 

4165 
4582 
4996 
5415 
5831 



12107 12897 

12453 13265 

12799 13634 

13145 14002 

13491 14371 

13837 14739 

14183 15108 

14529 15476 

14875 15845 

15220 16213 



.12 10102 

.10 10332 11107 11920 12771 13662 14594 15566 16582 

m 10562 11354 12184 13065 1^ 14918 15912 1^ 

^ 10791 11601 12449 13339 14269 15242 1^ 17319 

.04 11021 11847 imi 13622 U^ 15566 16604 17687 

^ 11250 12094 12979 13906 14876 15891 16950 18056 

.00 11480 12341 13244 14190 15180 16216 17296 18424 

m 22960 24682 26488 28380 30360 32430 34592 36848 39200 41650 —1.00 



5880 6248 

6272 6664 

6664 7081 

7056 7497 

7448 7914 

7840 8330 

8232 8747 

8624 9163 

9016 9580 

9408 9996 

9800 10413 

10192 10829 

10584 11246 

10976 11662 

11368 12079 

11760 12495 

12152 12912 

12544 13328 

12936 13745 

13328 14161 

13720 14578 

14112 14994 

14504 15411 

14896 15827 

15288 16244 

15680 16660 

16072 17077 

16464 17493 

16856 17910 

17248 18326 

17640 18743 

18032 19159 

18424 19576 

18816 19992 

19208 20409 

19600 20625 



P 
1.00 
.98 
.96 
.94 
.92 

.90 
.88 
.86 
.84 
.82 

.80 
.78 
.76 
.74 
.72 

.70 
.68 
.66 
.64 
.62 

.60 
.58 
.56 
.54 
.52 

.50 
.48 
.46 
.44 
.42 

.40 
.38 
.36 
.34 
.32 

.30 
.28 
.26 
.24 
.22 

.20 
.18 
.16 
.14 
.12 

.10 
.08 
.06 
.04 
.02 
.00 



122 THE SCOTT CX)MPANY LABORATORY 

NUMBER OF CASES RANKED 

p 51 52 53 54 55 56 57 58 59 60 

1.00 000000000000000000001 

.98 442 469 496 525 554 585 617 650 684 720 

.96 884 937 992 1049 1109 1170 1234 1300 1369 1440 

.94 1326 1406 1488 1574 1663 1756 1851 1951 2053 2159 

.92 1768 1874 1984 2099 2218 2341 2468 2601 2738 2879 

.90 2210 2343 2480 2624 2772 2926 3086 3251 3422 3599 

.88 2652 2811 2976 3148 3326 3511 3703 3901 4106 4319 

.86 3094 3280 3473 3673 3881 4096 4320 4551 4791 5039 

.84 3536 3748 3969 4198 4435 4682 4937 5201 5475 5758 

.82 3978 4217 4465 4722 4990 5267 5554 5852 6160 6478 

.80 4420 4685 4961 5247 5544 5852 6171 6502 6844 7198 

.78 4862 5154 5457 5772 6098 6437 6788 7152 7528 7918 

.76 5304 5622 5953 6296 6653 7022 7405 7802 8213 8638 

.74 5746 6091 6449 6821 7207 7608 8023 8452 8897 9357 

.72 6188 6559 6945 7346 7762 8193 8640 9103 9582 10077 

.70 6630 7028 7441 7871 8316 8778 9257 9753 10266 10797 

.68 7072 7496 7937 8395 8870 9363 9874 10403 10950 11517 

.66 7514 7965 8433 8920 9425 9948 10491 11053 11635 12237 

.64 7956 8433 8929 9445 9979 10534 11108 11703 12319 12956 

.62 8398 8902 9426 9969 10534 11119 11725 12353 13004 13676 

.60 8840 9370 9922 10494 11088 11704 12342 13004 13688 14396 

.58 9282 9839 10418 11019 11642 12289 12960 13654 14372 15116 

.56 9724 10307 10914 11543 12197 12874 13577 14304 15057 15836 

.54 10166 10776 11410 12068 12751 13460 14190 14954 15741 16555 

.52 10608 11244 11906 12593 13306 14045 14811 15604 16426 17275 

.50 11050 11713 12402 13118 13860 14630 15428 16255 17110 17995 

.48 11492 12182 12898 13642 14414 15215 16045 16905 17794 18715 

.46 11934 12650 13394 14167 14969 15800 16662 17555 18479 19435 

.44 12376 13119 13890 14692 15523 16386 17279 18205 19163 20154 

.42 12818 13587 14386 15216 16078 16971 17896 18855 19848 20874 

.40 13260 14056 14882 15741 16632 17556 18514 19505 20532 21594 

.38 13702 14524 15378 16266 17186 18141 19131 20156 21216 22314 

.36 14144 14993 15875 16790 17741 18726 19748 20806 21901 23034 

.34 14586 15461 16371 17315 18295 19312 20365 21456 22585 23753 

.32 15028 15930 16867 17840 18850 19897 20982 22106 23270 24473 

.30 15470 16398 17363 18365 19404 20482 21599 22756 23954 25193 

.28 15912 16867 17859 18889 19958 21067 22216 23406 24638 25913 

.26 16354 17335 18355 19414 20513 21652 22833 24057 25323 26633 

.24 16796 17804 18851 19939 21067 22238 23451 24707 26007 27352 

.22 17238 18272 19347 20463 21622 22823 24068 25357 26692 28072 

.20 17680 18741 19843 20988 22176 23408 24685 26007 27376 28792 

.18 18122 19209 20339 21513 22730 23993 25302 26657 28060 29512 

.16 18564 19678 20835 22037 23285 24578 25919 27308 28745 30232 

.14 19006 20146 21331 22562 23839 25164 26536 27958 29429 30951 

.12 19448 20615 21828 23087 24394 25749 27153 28608 30114 31671 

.10 19890 21083 22324 23612 24948 26334 27770 29258 30798 32391 

.08 20332 21552 22820 24136 25502 26919 28388 29908 31482 33111 

.06 20774 22020 23316 24661 26057 27504 29005 30558 32167 33831 

.04 21216 22489 23812 25186 26611 28090 29622 31209 32851 34550 

.02 21658 22957 24308 25710 27166 28675 30239 31859 33536 35270 

.00 22100 23426 24804 26235 27720 29260 30856 32509 34220 35990 

—1.00 44200 46852 49608 52470 55440 58520 61712 65018 68440 71980 — 1 
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NUMBER OF CASES RANKED 



p 


61 


62 


63 


64 


65 


66 


67 


68 


69 


70 


P 


1.00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


00 


1.00 


.98 


756 


794 


833 


874 


915 


958 


1002 


1048 


1095 


1143 


.98 


.96 


1513 


1588 


1667 


1747 


1830 


1916 


2005 


2096 


2190 


2286 


.96 


.94 


2269 


2383 


2500 


2621 


2746 


2874 


3007 


3144 


3284 


3429 


.94 


.92 


3026 


3177 


3333 


3494 


3661 


3832 


4009 


4192 


4379 


4572 


.92 


.90 


3782 


3971 


4166 


4368 


4576 


4791 


5012 


5239 


5474 


5716 


.90 


.88 


4538 


4765 


5000 


5242 


5491 


5749 


6014 


6287 


6569 


6859 


.88 


.86 


5295 


5560 


5833 


6115 
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CORRELATION COEFFICIENTS 
VALUES OF r CORRESPONDING TO VALUES OF p* 







TT 








r = 2 sin 


6 






p 


r 




9 


r 


00 


.00 




.52 


.54 


02 


.02 




.54 


.56 


04 


.04 




.56 


.58 


06 


.06 




.58 


.60 


08 


.08 




.60 


.62 


.10 


.10 




.62 


.64 


12 


.13 




.64 


.66 


,14 


.15 




.66 


.68 


,16 


.17 




.68 


.70 


,18 


.19 




.70 


.72 


,20 


.21 




.72 


.74 


22 


.23 




.74 


.76 


.24 


.25 




.76 


.78 


.26 


.27 




.78 


.79 


.28 


.29 




.80 


.81 


.30 


.31 




.82 


.83 


.32 


.33 




.84 


.85 


.34 


.35 




.86 


.87 


.36 


.37 




.88 ^ 


.89 


.38 


.40 




.90 ^ 


.91 


.40 


.42 




.92 


.93 


.42 


.44 




.94 


.95 


.44 


.46 




.96 


.96 


.46 


.48 




.98 


.98 


.48 


.50 




1.00 


1.00 


.50 


.52 









♦The maximum change from p to r is .018, a difference that may ordinarily be neglected. 



Digitized by 



Google 



CLINICAL STUDY AS A METHOD IN EXPERI- 
MENTAL EDUCATION 



By Frank N. Freeman, University of Chicago 

The purpose of this paper is to present some reflections 
upon the relationship between group study and individual 
study as a method of educational investigation, to discuss 
some of the advantages of individual study and to present as 
an illustration the investigation of a case of " word blindness " 
or " alexia " and its treatment. The illustrative study is 
presented first. 

Analytical Study of a Case of Alexia 

The subject of this study is a girl, V. P., nine and one half 
years old, in the fourth grade. In the Fall of 1919, when 
the study was begun, she had been in school three years 
and had been in the hands of a tutor for one year. She 
was, however, unable to read and was totally unfit to do the 
work of the grade. She was referred to the educational 
laboratory for diagnosis and treatment. 

Inquiry revealed the fact that the father and mother were 
of more than average intellectual ability. The father was a 
very successful business man and the mother active in the 
life of the community, in which she took a position of leader- 
ship. It appeared, however, that the father had had diffi- 
culty in learning to read and that he was still a very poor 
oral reader. The difficulty with reading also extended to 
the father's sister. 

The child herself was slow in learning to talk. According 
to her mother she began to talk at seventeen months and still 
talked indistinctly at two and a half years of age. At the 
present time she talks clearly and with the average fluency. 

The child had been in the University Elementary School 
for two years, including the first grade, and had there re- 
ceived the ordinary instruction in reading, which includes a 
considerable amount of sight reading, and in which phonetic 
analysis is also emphasized. In addition to this the child had 
been instructed for a year by a tutor and this instruction 
had included a very large emphasis on phonetic drill. More- 
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over, in her second year she had been given special help in 
reading by her teacher. In spite of all this intensive training, 
the child, when first seen, was unable to read a primer as 
well as is a first grade child at the end of the year. 

At the outset a series of tests were made in the attempt 
to locate the difficulty more precisely. The child had been 
diagnosed by a well known oculist in the city as having " word 
blindness.* His prognosis was very discouraging, and he 
advised the child's mother that she would be unable to learn 
to read. It is clear that we were confronted with a case which 
is termed in general " word blindness " or " developmental 
alexia." 

The first step was to discover whether there was any gen- 
eral intellectual defect. The dhild was given the Binet test. 
This test was carried far enough to establish the fact clearly 
that the child is of normal general intelligence. This con- 
clusion was re-enforced by her general reaction, speech and 
manner, and also by her ability in the studies of the school 
which do not involve reading. 

In addition to the Binet test a number of other general tests 
of the functions which can be supposed to be related to 
reading and to speech processes in general were made. It has 
already been remarked that the child was normal in general 
visual sensory capacity. In order to discover whether the 
difficulty in reading could be related to a general deficiency 
in the motor processes, the tapping test and steadiness test 
were made. In both of these the child's reaction was 
normal and the ability of the right hand was superior to that 
of the left. Since left-handedness and speech difficulties 
sometimes appear together these results had some significance 
as indicating lack of such deficiency. From observation the 
child's oral speech appeared to be moderately fluent and nor- 
mally well coordinated. No difficulties were observed in the 
auditory speech ; that is, the child is able to understand spoken 
language normally well and is able to reproduce from auditory 
presentation with normal accuracy and fullness. 

As a check upon ability in general intellectual operations, 
as well as ability to grasp certain kinds of visual symbols, 
several examples in simple number combinations were pre- 
sented visually. The child's reaction in these respects pre- 
sented nothing abnormal. 

In order to make further examination of the visual per- 
ception to determine whether the defect was due to general 
inability to apprehend visual symbols, the child was given the 
Binet Pictures Test. She responded fluently by giving descrip- 
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tions of the pictures, indicating that she was able to grasp the 
visual objects as shown in the pictures without any difficulty. 
A test in the recognition of more abstract forms consisted in 
requiring her to match the artificial forms used in Thorn- 
dike's test. She was able to identify the forms without any 
difficulty. In order to extend this test she was asked to match 
words without giving their meaning and she was able to do 
this readily. She was also able to cross out the a's in a pied 
text with average speed and accuracy. 

Thus far the tests have not involved visual language in 
the sense of the recognition or the pronunciation of words; 
and in none of the tests which have been thus far described, 
involving visual sensation, motor processes, motor or auditory 
speech or visual perception, is discovered anything out of the 
ordinary. 

In visual language a test was first given in the ability to pro- 
nounce nonsense syllables. This involves the translation of 
visual stimuli into sound. The child was able to make this 
translation and to pronounce the syllables, but did so slowly. 
The recognition of meaning was not involved in this test. 

The next test involves the opposite process of translating 
sounds into visual symbols, namely spelling. In this the diffi- 
culty was somewhat greater than in the pronunciation of non- 
sense syllables. The simple words, the, and, and tone were, 
spelled correctly and fairly readily, but there was difficulty 
with the words horse and house and with the word town. 
The child spelled these very slowly and there was evidence of 
confusion from the similarity of the diflFerent words. The 
child's difficulty appears, therefore, in some way connected 
with the translation between visual and sound symbols. 

We turn now to the reading tests themselves. At the begin- 
ning of the year the subject had been given the routine reading 
tests in company with the other children of the school. These 
consisted of the Gray Oral Reading Test and the Courtis 
Silent Reading Test No. 2. In both cases the child was 
recorded as having made no score. At the time of the exam- 
ination made by the writer the Gray Silent Reading Test was 
given. The easiest specimen, entitled " Tiny Tad," which is 
designed for second and third grades, was given. The rate of 
reading was .5 words per second and the quality was cal- 
culated as .23. The average rate for the second grade is 
1.96 and the quality .252. In order to equal the quaHty of 
the second grade, therefore, the child's reading was reduced 
to one quarter normal speed. When given primer material 
she read very slowly and hesitantly and frequently became 
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confused. It seemed useless to attempt to give other standard 
tests since the reading was so poor as to be below the range 
which is ordinarily represented in the scores of these tests. 
In order to get an objective record of the child's behavior 
in reading photographs were taken of her eye movements. 
The first reading of a passage of simple material is shown 
1 
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F:g 1.— Photographic record of eye movements in reading taken at 
the beginning of training. 
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at the left of Fig. 1. In order to interpret this figure it is 
necessary to know what kind of record would be made in 
normal reading. A fairly good example of this may be seen 
in the record of the first line of the second reading, Fig. 1. 
This record consists in a series of straight vertical lines inter- 
rupted by short jogs to the left. The short vertical line repre- 
sents a steady fixation of the eye and the jog to the left repre- 
sents the movement of the eye along the line toward the right 
to the next fixation point. Reading should consist of a series 
of steady fixations of comparatively uniform length, inter- 
rupted by regular movements across the page. It appears 
from this second record that V. occasionally used this typical 
reading movement, but it occurred only on the second reading 
of the same text and even here only for a small part of the 
text. 

Observe now in contrast the record of the first reading 
shown on the left of the figure. Instead of a series of fixa- 
tions interrupted by abrupt movements there is here a gradual 
shifting or wandering of the eye. There is apparent no 
regular rhythmical series of forward movements and fixations, 
and the movement is so irregular that it is impossible to deter- 
mine what positions in the record correspond to the beginning 
and the end of the line. From our knowledge of the ordin- 
ary type of eye movement in reading, it may be said with 
confidence that there is nothing here that corresponds to the 
typical reading habit. The irregular and uncoordinated eye 
movement must correspond with confused mental processes. 
An irregular movement of the eye indicates that the attention 
does not progress in an orderly fashion along the sentences 
and the parts of sentences. 

In the second record, in which the same text was read 
over again, the first two lines were read in fairly well organ- 
ized fashion, but in the third line confusion begins and con- 
tinues throughout the passage. Observe, for example, the 
last line shown on the record represented on the right hand 
side of the figure. This line begins about one third the dis- 
tance down the figure, at the point where the record line shifts 
toward the right. The first fixation (a) is evidently not 
at the right point, and after a brief space the eye shifts still 
further toward the beginning of the line (b). It does not 
remain here, however, but shifts back to the original position 
(c) for an interval which is less than ordinary fixation time, 
then moves forward and pauses (d), again moves back again 
to nearly its original position (e) and makes a slight shift 
toward the end (f). This fixation is again abandoned by a 
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movement which apparently is not horizontal. The horizontal 
movements of the eye give a record which slopes somewhat 
downward, due to the movement of the film. Since the move- 
ment in question is represented by a horizontal line, it must 
have been an upward movement. The next fixation is not 
a steady one, but is interrupted by another backward shift. 
The eye then returns toward the beginning of the line (i). 
It is about at the point where it started from and the proba- 
bility is that very little if anything has been read. Even this 
wholly irregular succession of movements is much more 
definite than the wandering movements represented in the 
record from the first reading. 

It is obvious that the instruction in reading which the 
child had received up to this time had failed lamentably 
in the development of the characteristic eye movement habit. 
In the first reading of the passage, which is well within the 
child's comprehension, the eye movement is utterly disorgan- 
ized, and even in the second reading of such a passage the 
irregular disorganized movement is predominant. We may 
conclude from these records that the movement of attention 
in reading is highly irregular. Instead of going forward step 
by step, it skips about, sometimes jumping to a point ahead" 
of where it should be and at other times moving backward 
over the part which has already been read. This irregularity 
is in all probability due to the child's failure to grasp the 
meaning of the words which are fixated by the eye. Failure 
to grasp the meaning results in the return of the eye to the 
parts already fixated and in a slow wandering movement or 
a succession of movements made at short intervals rather than 
a series of clear cut movements just long enough to cover the 
space which can be fixated at a single pause. 

On the basis of this examination the child's condition was 
diagnosed in the following way. There is no deficiency in- 
general intelligence. Furthermore, the child's vision is entirely 
normal and she is able to recognize and to interpret the 
meaning of ordinary visual percepts. There is no general 
motor deficiency or general language disturbance. The defect, 
therefore, must be a highly specialized one and apparently 
consists in an inability to make the association between visual 
symbols and the sound of the words. When a child begins- 
to learn to read he already has made the association between 
the word sound and the meaning. In the ordinary procedure 
he then proceeds to make the further association between; 
the visual percept of the word and the sound, and by this 
means forms the visual-meaning association through the inter- 
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mediate agency of the sound. In the case of this child the 
connection between the printed word and the meaning was 
very imperfectly made. Upon attempting to read the child 
began to sound the words, but did this only with great diffi- 
•culty, and arrived at the meaning very slowly and very im- 
perfectly. In this process the attention became confused 
and the eye movement incoordinated. 

This condition was present in spite of intensive phonetic 
drill. The consequence of this drill was seen in the fact that 
the sound characteristics of words were uppermost in the 
child's mind. In fact they so obtruded themselves upon her 
attention that they formed the chief meaning of reading to 
her. The aspect of phonetics which preoccupied her atten- 
tion was the sound of the individual letters and her reading 
consisted in the attempt to get the sound of the word from 
these abstract letter sounds. This attempt was also uppermost 
in her spelling. For example, she spelled the word dyer, dir. 
It is quite obvious how she arrived at this spelling. The d 
and the i are quite phonetic, and the letter r is commonly 
pronounced or in the teaching of phonetics. The child was, 
therefore, more correct than her teachers, for it is obviously 
inaccurate to represent the sound of the letter r by the syllable 
er as is regularly done. This illustrates, by the way, the pit- 
falls of a highly analytical type of phonetic drill. 

The conclusion was arrived at that for this child, at least, 
phonetic drill had been carried beyond the point where it was 
useful. Instead of being the means to the recognition of 
word meaning it had become an end in itself, and really blocked 
the recognition of the meaning. The treatment.^ therefore, had 
as its first object the short-circuiting of this roundabout 
association and the attempt to develop a more direct associa- 
tion between the sight of the words and their meaning. For 
the time being, then, all phonetic analysis was abandoned, but 
later on some attention was given to the syllabication of words 
in order to develop the recognition of the typical sounds repre- 
sented by the different letter combinations. Rut this analysis 
Avas always made with real words, and the habit of recording 
letters as mere sounds was broken up. 

As an incident to these processes an attempt was made to 
bring about a much more fluent word recognition. It will 
be remembered that the child's speed of silent reading was 
about one fourth of that which is normal for the second 

' The training was very efficiently conducted by Miss Claire Moore. 
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grade child. For this purpose easy reading material was. 
given and the child was encouraged to run through the sen- 
tences in order to get the meaning rapidly. In this type of 
training, however, an opposite difficulty was encountered, 
which grew out of the fact that the child had not developed; 
coordinated eye movements or a regular progression of atten- 
tion. It was found that she was very apt to shift about on: 
the page, to fail to read a considerable part and to fill in the 
gaps by guessing. It was necessary, therefore, to restrict her 
reading of larger units for some time and to compel her to 
give close attention to every part of what she read. 

In the earlier stages certain devices were used to compel 
this attention to all the details of the passage. The passage 
was broken up into sentences and the individual sentences 
typewritten on separate slips of paper. The child then read 
the passage sentence by sentence. Another device was to place 
a card upon the page and move it forward as rapidly as the 
child read. In addition to these methods flash card work was. 
given, and some use was made of printed directions which 
the child followed out by appropriate action. This was found 
to be of considerable interest to her and stimulated her to 
give attention to meaning. It was also found useful to give 
her practice in reading problems in arithmetic, which forced 
her to give attention to the meaning of each element in the 
sentence. 

In addition to these drill devices the child was given con- 
tinuous reading material which at the beginning was very 
easy. This was for the purpose of encouraging fluency with- 
out the loss of meaning. The difficulty of material was ad- 
vanced as rapidly as the child could go, and a certain amount 
of work was also given with still more difficult material 
because of its inherent interest to the child. Comparatively 
brief periods of intensive work with difficult material was 
found to be stimulating and to be helpful in carrying her to 
a higher level of recognition than was habitual. 

Parallel with this specific reading instruction there was prac- 
tice in spelling and in writing words and sentences. The child 
was very poor indeed in spelling and her development in this 
respect still remains behind the development in reading. 
Probably this deficiency will be permanent. 

Along with the practice in reading itself there was a good: 
deal of work which was intended to direct the child's atten- 
tion to the meaning of what was read, to prepare her to grasp 
the meaning by anticipating the difficulties. Before any passage^ 
was read, the general topic was discussed and the child's. 
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curiosity in it was aroused. At the same time particularly 
difficult words were written on the board and studied. In 
this way the habit of slurring over unknown words or of 
pausing too long to study them was avoided. 

The period of experimentation which is covered by this 
report was from the early part of October until a little before 
Christmas. Two weeks were lost from this period by sick- 
ness. The child was in the regular school grade except for 
forty-five minutes five days in the week, when she was given 
the type of training which has been described. At the end 
of this period reading tests were again given and another 
photograph was taken of the eye movements. 

It will be remembered that the child made no score in the 
Gray Oral Reading Test at the beginning of the year. After 
about ten weeks of training she made a score of 36.25. This 
is about half way between the norms for grades I and II. 
In the Courtis Silent Reading Test, she read at a rate of 3.2 
words per second, which is six times as fast as at the begin- 
ning and equals the standard for grade \ I. This was too 
rapid in comparison with the child's understanding, and indi- 
cates that it was necessary to check her speed and to emphasize 
the meaning. This has accordingly been done in subsequent 
training. The number of questions answered in this test was 
34, which is half way between the standards for grades IV 
and V. The index of comprehension was .62, w^hich is be- 
tween the standards for grades II and III. This index, how- 
ever, is somewhat unfair to the child, .^n examination of 
her paper showed that she answered the questions much more 
accurately during the first three minutes of the test, but that 
then she lost control and began to guess. This indicates the 
instability of her reading habit. If we take the first three 
minutes we find that the number of quc^tinn^ was 32, e<fir'v'v 
lent to the standard for grade IV. and the index of compre- 
hension .79, which was equal to the standard of grade III. 
Thus the child has made progress in the two weeks training 
equivalent to perhaps three years ordinary progress in a school. 

At this same time a second photograph was taken of the 
child's eye movements. This photograph is shown in figure 
2. A different passage was used from that used in making the 
first photograph. While some of the record is dim, it is clear 
enough to indicate great progress in the development of a 
well organized eye movement. No line was read in as dis- 
organized a fashion as was typical of the earlier reading. 
Most of the lines were read wMth a fairly well organized eye 
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Fig. 2. — Photographic record of eye movements in reading taken 
after ten weeks' training. 
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movement habit. The progress in the eye movement habit 
thus runs parallel to the progress in reading ability. 

The prediction of the oculist that V. would not be able to 
learn to read has been proven to be unfounded. Her mother 
reports that she shows spontaneity and interest in reading at 
home. She is still considerably below the standard for her 
grade and probably will always be a reader of very moderate 
ability. There is no evidence, however, that she need suffer 
the serious handicap of illiteracy. The training of the child 
is now being continued and in order to make her work har- 
monious she is being given special instruction in other subjects 
in connection with the work in reading. The hope is that 
eventually she may return to the regular school grade. 

Conclusions from the Individual Study 
From this case we seem warranted in drawing the follow- 
ing conclusions. 

1. We seem justified in raising a serious question whether 
there is such a thing as specific congenital word blindness or 
" alexia." It is doubtful whether there are any children of 
normal intelligence and vision who are unable to learn to read. 
This conclusion is supported by the experiments of Dr. Clara 
Schmitt,^ and Supt. C. J. Anderson and Miss Merton.'* 

2. In treating a case which presents special difficulty it 
may not suffice to simply give more intensive drill of the 
kind which is suited to average children. It may often be 
necessary, and perhaps is usually necessary, to give a specially 
adapted drill. In any case it is necessary to follow the devel- 
opment of the individual case, to examine the child to find 
out just what his stage of progress and his difficulties are, 
and to adapt the training moment by moment to the stage 
at that particular time. Supt. Anderson's work indicates 
that this type of diagnostic treatment can be carried on by the 
room teacher, and does not necessitate special laboratory 
facilities. It will, of course, require a somewhat unusually 
trained teacher to carry on such work at the beginning. 

3. There are certain limitations to the usefulness of a con- 
scious phonetic analysis in reading. There are two possible 
interpretations of the case. The first is that there are certain 
individuals for whom conscious analysis is more difficult than 

2 Clara Schmitt, Developmental Alexia. Elementary School Jour- 
nal, 1918, vol. 18, pp. 680, 757. 

^ C. J. Anderson and Elda Merton, Remedial Work in Reading, 
Elementary School Journal, 1920, vol. XX, pp. 685-701 and 772-79\, 
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for others, and with whom this analysis should be very much 
reduced if not eliminated. The other possibility is that this 
conscious analysis is suited only to certain periods in the 
development of reading and that if it is carried beyond this 
period it greatly retards progress. Both of these sujypositions 
are possible in the present case. Which ever one is correct 
we may at least make the general statement that phonetic 
analysis when made consciously has limitations which should 
not be overlooked. 

4. The lack of proper development of word recognition is 
accompanied by the formation of faulty eye movement and 
attention habits. Special practice is required to overcome these 
faulty habits when they have been developed through ill 
adapted previous training. It is possible for special training 
to bring about radical improvement in the eye movement. 

5. The extension of the method of individual diagnosis and 
training promises very large economy of time and effort in 
the work of the school. How far we should go in the direc- 
tion of individual instruction no one can predict. There are 
good reasons to believe that we should not abandon class 
instruction. If we are to retain it. however, we must find 
some means of overcoming the tremendous waste which results 
from a number of children marking time as a consequence of 
the lack of adaptation of the work to their individual require- 
ments. 

The need of individual attention in the school is paralleled 
by the need of individual study as a method of research. 
The rest of the article is a comparison of the individual and 
the group methods. 

- The Need of Analytical Study of Individuals 
The prevailing method of study in education, and to perhaps 
a lesser degree in psychology, is the investigation of groups. 
Experimental psychology began with an intensive and analy- 
tical study of individuals. The subject of individual psy- 
chology or of individual differences was scarcely considered 
in the early period. Individual differences were in fact looked 
upon implicitly, if not with full consciousness, as errors to be 
disregarded, or to be overcome by a more perfect technique. 
With the direction of attention upon individual differences 
following the work of Stern, Binet and Galton, there has come 
into use a much more extensive and comparative study of 
groups and as an instrument to this study there has been 
developed an elaborate statistical technique. This statistical 
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technique has enabled us to discover facts and to make state- 
ments about the group which previously we were not able 
to make. There is no reason for undervaluing the importance 
of this method and the light which its use has thrown upon 
facts relating to groups. There are some questions which 
the group method is capable of solving. There are other 
questions, however, for the study of which an individual 
analytical study is equally if not better suited, and it is desir- 
able, in view of the current disposition to neglect it in com- 
parison with the group method, to analyse the situations in 
which the individual method is applicable. 

Group study is applicable to at least three types of problems. 
First, the determination of central tendencies, second the 
determination of variations from the central tendencies, and 
third the discovery of relationships. We have only to glance 
at the studies in the field of psychology during the first 
twenty or twenty-five years of its development, to find a plenti- 
ful number of cases in which the crudest types of calculations 
were made. Statements in regard to the average performance 
of the group were made without regard to the most elementary 
necessities of statistical method. The number of cases might 
be too few, or type of distribution might be disregarded, 
or the question whether the average or the median was the 
best measure of central tendency to use was commonly dis- 
regarded. As a consequence the question of the reliability 
of such statements was not raised. This was particularly 
pernicious when the averages of two groups were compared. 
Frequently the interchange of a single case from one group 
to another might alter the averages sufficiently to change the 
relative position of the two groups. Furthermore, the range 
of the variation of the individuals within a group, the char- 
acter of the variation, whether according to the normal fre- 
(juency distribution or some other type, the relation of the 
variation to a comparison of averages, were not treated at 
all in many, if not most of the early studies. These elementary 
principles regarding the statistical treatment of measures of 
the group are now to be taken for granted. 

When we come to the study of relationships, however, the 
honors are divided between the study of large groups and 
the study of individuals. There are many problems raised 
by means of the study of groups which can be settled only 
by the addition of the study of individuals. A few examples 
may be cited of i)roblems which have been studied by the 
group method but in which the results are not entirely satis- 
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factory and in a solution of which it would be very desirable 
to add to the group study the study of individuals. 

Consider, for example, the various methods of learning. 
The comparison between the efficiency of the part methcxl 
and the whole method of memorizing has been investigated 
by having a g^oup memorize first by one method and then 
by another, or, by having one group use one method and 
another the second method. The results of learning by the 
part method and the whole method are then averaged and 
from the comparison of these averages the conclusion as to 
which is the better method is drawn. Now such a conclusion 
might be statistically sound and yet psychologically false. It 
might, for example, be true that over half of the individuals 
selected at random could learn better by the whole method and 
fewer than half, say forty per cent, could learn better by the 
part method. If a large number of individuals are given both 
methods it may be an accurate statement in reference to the 
group to say that on an average the whole method gives better 
results because in the long run the greater numt^r of indi- 
viduals can use this method more advantageously. However, 
it might also be true that the forty per cent of individuals 
were so constituted that they could always learn better by the 
part method. The average results, therefore, could not apply 
to them. 

Take another illustration. There have been recent attempts 
made to discover what is called the general form of the 
practice curve. This attempt may consist in putting together, 
by means of the average, the results of the practice curves 
of different individuals, or of putting together practice curves 
of different types of learning. The second method is perhaps 
not so readily accepted as the first, but even this, in the judg- 
ment of the writer, is not justified. The only assumption on 
which it is justified is that the variations of the curves which 
represent the progress of different individuals are accidental. 
In other words, if one individual gains more rapidly at the 
beginning, and another one more slowly, than the average, 
this difference would on this assumption be ascribed to some 
accident in their previous history or in the circumstances sur- 
rounding their work, rather than to a fundamental difference 
in their mode of learning. Certainly, at least, the burden of 
truth is upon this assumption; and unless it can be substan- 
tiated we must regard an average of the practice curves of 
different individuals as a mathematical fiction. 

Again, consider the problem of the relationship between 
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Speed and accuracy. There have been a considerable ntunber 
of studies, particularly in the school subjects, which have 
compared the relationship between the speed and accuracy 
of the performance of diflFerent individuals. This may be 
done by grouping individuals' scores according to the double 
criterion and arranging the groups in a single scatter or dis- 
tribution table. If the individuals are arranged into three 
groups on the basis each of speed and accuracy, there would 
be nine groups in all which would be formed. By a com- 
parison of the number of cases in the nine groups it is pos- 
sible to determine whether or not individuals with high speed 
are likely to excel in accuracy or whether the reverse is the 
case. In general, the conclusion has been reached that, con- 
trary to a widespread popular opinion, high degree of speed 
is likely to be associated with high degree of accuracy. This 
is a very valuable bit of information and enables us to predict 
within wide limits of variation the probability of various com- 
binations of speed and accuracy in an individual. There has 
been, however, a tendency to make application of this fact to 
the training of individuals, which is to say the least uncertain, 
and which could be very much more securely founded upon an 
experimental and anal)rtical study of the individuals themselves. 
Because an individual who works at high speed also works 
with superior accuracy we cannot conclude safely, as has 
sometimes been done, that for an individual to increase his 
speed will result in an increase in his accuracy. This may 
or may not be true, but we can only determine its truth and 
the limits within which such a relationship holds, by training 
individuals to work at various speeds and testing the effect 
upon the accuracy of their performance. 

This leads us to the treacherous question of correlation. 
What does a correlation between two traits mean? Assume 
a correlation of .60 and assume further that the correlation 
coefficient expresses the real relationship. What does such 
a coefficient mean with reference to the relationship between 
the traits in question in the various individuals of the group. 
Obviously it may mean different things. We may say that 
there is a strong tendency for the two traits to be related. 
but we are here speaking in figurative terms. In any 
given individual the traits are either related closely or 
they are related remotely or not at all. A moderate 
degree of correlation might mean that there is a fairly 
close relationship between two traits in every individual 
of the group, or it might mean that the relationship was very 
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dose in some individuals and very slight in the case of others. 
In order to make entirely clear to ourselves what such a 
co-efficient means it is necessary to get within our mental 
grasp the varieties of the types of cases which exist in the 
individuals of a group. The classification of individuals into 
such types is necessary before we are able to determine the 
administrative application to make of a given degree of corre- 
lation. For example, it was found in the study of the correla- 
tion between pupils' standings in High School subjects, that 
there are all types of cases from those of one extreme in which 
the standing in the different subjects was highly consistent 
to those in which there was an extreme divergence in the 
standing in the different subjects. Intermediate between these 
were pupils in whom the standings in different subjects varied, 
but not to an extreme degree. The combination of the relation 
between the scores of all the pupils into a single correlation 
coefficient in the case of a pair of subjects would result in a 
moderate degree of correlation, but obviously it would not be 
just to treat a pupil in whom ability in two subjects was equal 
on the assumption that the relationship was only moderate; 
and furthermore, on the other hand, it would not be correct to 
treat a pupil in whom ability in the two subjects was opposed 
on the assumption that they were related to a moderate degree. 
We should keep in mind continually that it is individuals 
with whom we are to deal and that our conclusions should al- 
ways be in terms of individuals. An individual is a complex of 
many traits and abilities. When the question of failure in 
learning, for example, arises in the case of an individual, 
it is necessary not only to know that a condition may arise 
in such a certain percentage of cases from one cause, and in 
another percentage from another cause, etc., but it is neces- 
sary to know what condition or conditions actually produce 
the failure on the part of the individual before us. In such 
an attempt to diagnose the condition of an individual we see 
the necessity of the combination of the method of group 
study and of individual study. We proceed to investigate 
the ability of an individual in various processes, but the 
only ground on which we can determine whether this ability 
is high or low is by a comparison with the ability of the 
group to which the individual belongs. Thus in order to diag- 
nose reading ability, arithmetic ability or spelling ability of 
a fourth grade child we should compare the scores which he 
makes with those of the norms for his age or grade. In this 
way group study and individual study are combined. 



Digitized by 



Google 



SIGNIFICANT RESPONSES IN CERTAIN MEMORY 

TESTS* 



By Josephine Curtis Foster, Fonncriy Chief Psychologist, Psycho- 
pathic Hospital, Boston 



The psychologist who gives a large number of "mental 
tests " to a variety of patients comes to recognize certain 
responses as unusual. Perhaps, judging from failures of a 
subject in early tests, he gets " set " for a certain grade of 
answers and so is surprised at a correct response. Thus fre- 
quently an examiner will report : " There is something queer 
about that examination. I don't believe that patient is feeble- 
minded, in spite of the low rating." 

We have been trying at this hospital for some time to get 
a numerical statement of this " queerness." We have already 
reported our method of calculating the irregularity* of the 
Point Scale examination. We wish now to suggest other 
features in the psychological examination which should lead 
the examiner immediately to suspect that he is dealing with a 
psychosis or with some deteriorating process. We do not, of 
course, wish to claim that the psychologist should be capable 
of making a psychiatric diagnosis. Far from it! But we 
believe that the psychologist should be able to recognize cer- 
tain cases as cases properly to be referred to a psychiatrist, 
and that he should be able to make a guess as to whether 
low mental age is attained as a result of lack of development 
or as the effect of some retrograde process in a subject whose 
mentality was previously normal. 

What we need is not so much new tests, as the understand- 
ing and interpretation of the results from the tests which 
are at hand. In the present paper we shall consider the 
different types of reactions found in the tests of memory. 
There are three kinds of memory tests in the routine psycho- 

1 The writer is greatly indebted to Miss Katherine T. Gere, formerly, 
psychological interne at the Psychopathic Hospital, for her work in 
collecting data and assisting in the arrangement of results. 

2 Josephine N. Curtis, " Point Scale Examinations on the Higfa- 
Grade Feeble-Minded and the Insane," Journal of Abnormal Psychol' 
ogy, XIII, 1918, p. 88 ff. 
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logical examination commonly given at this hospital: (1) 
memory span for digits and sentences; (2) memory for the 
two Binet drawings after an exposure of 15 sec.; and (3) 
the recall of short paragraphs : one in year X of the Stanford 
revision of the Binet scale, and two Healy tests, in which 
the subject is required to recite what he can of a selection 
read aloud, in the one case by himself, in the other by the 
examiner. 

All cases considered in this paper were examined during 
the last two years. All but approximately 5% of the exam- 
inations have been corrected by the same person before a 
final score was given, thus avoiding individual variations in 
the grading of the separate tests. No case in which there 
was language difficulty, poor co-operation, or disagreement 
as to diagnosis has been considered. The work of com- 
putation has extended over eight or nine months. The total 
niunber of cases discussed under the different sections, there- 
fore, is not always the same. Since the selection has always 
been on a uniform basis, however, the results are compar- 
able. We shall take up the separate tests in the order men- 
tioned, and try to show what reactions should be noted by 
the examiner and reported as of significance for diagnosis. 

Memory Span 
In this part of the investigation we used the records of 
patients described in Table 1. 

TABLE I 

Cases Used in Discussion of Memory Span 

Number Diagnoses Made by Hoepital 
of Cases Psychiatrists 

41 "Not Insane" 

46 Feeble-Minded 

56 Dementia Praecox 

45 Alcoholic Psychoses 

16 Manic-Depresshre Psychoses 

13 General P^esis 

10 Unclassified Paranoid Condition 

We have also partial records' of 503 normal school children 
who were examined in obtaining the first norms for the Point 
Scale, but their average chronological age and their drawings 

< These data were very kindly supplied by Dr. R. M. Yerkes. 
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were not available. We include their results in some tables 
for comparative purposes. 

From the calculation of these data according to diagnosis, 
mental age, and chronological age of the patient, we have 
concluded that the memory span for digits is of little signifi- 
cance in our present problem. To be sure, with all patients, 
whatever the diagnosis, memory span increases with advanc- 
ing mental age ; but the increase is so slight that after mental 
age 10 we can show it only by keeping a decimal place. In 
general, we may say not only that for all mental ages over 
10 we may expect a memory span of six or seven digits, but 
also that one of only five digits is not unusual. When the 
cases with diflferent diagnoses are grouped by chronological 
ages, again we find no significant dififerences. For example, 
for the four decades, from ten to forty-nine, our " not insane " 
cases give averages of 6.4, 6.5, 6.6, and 6.3 while dementia 
praecox patients give 5.3, 6.0, 5.3, and 5.7. Similarly patients 
sufifering from other diseases show no regular change in the 
memory span with advancing chronological age. That the 
diagnosis itself has little or no relation to the memory span 
may be iseen from the fact that if we use only those case^ 
where the mental age is 11.5 or over, so that we surely get 
no influence of mental age, we find the average number of 
digits given to be : subjects suffering from dementia praecox, 
5.8; from alcoholic psychoses, 5.9; from tmdassified paranoid 
condition, 5.9; from manic-depressive psychoses, 6.1; those 
"not insane," 6.5; and the feeble-minded, 6.8. The greatest 
difference, 1.0, is too small to be considered significant in 
view of the small number of cases and the possible selective 
factors involved. 

The memory span for sentences, at least as given in the 
Point Scale, is useless for our purposes. Practically no patient 
succeeded in repeating the fourth (that is to say, the longest) 
sentence, and practically no patient failed to repeat the two 
short sentences. There was, then, only the question of 
whether some patients could give the third (next to the long- 
est) sentence. The scores here showed no uniformity and we 
concluded that the performance is poorly constructed to show 
a relation to mental age, to chronologicsd age, or to diagnosis. 

The examiner, therefore, need pay little attention to either 
of the memory span tests so far as diagnostic hints are con- 
cerned. 

Memory for Drawings 

In this part of the investigation we used the records of 
patients grouped in Table 2. 
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TABLE 2 

Cases Used in Discussion of Memory Drawings 

Average Average 
Number Diagnosis Point Sode Chixmo- 

of Cases Score logical Age 

72 " Not Insane " 

183 Feeble-Minded 

121 Dementia PraecoK 

23 Syphilitic P^choees 

14 Unclassified Paranoid Condition 

42 Acute Alcoholic PSvchoees 

20 Deteriorating AloMioiic Pftychoees 

35 Manic-Depressive Pftychoees 

13 Arterio-Sclerotic Pftychoees 

10 Senile Dementia 

It is evident from our results that the psychological examiner 
must take a number of factors into account in making an 
estimate of the significance of failures or successes in this 
test. When we fractionate our cases for, and distribute 
according to mental age we find a tendency for the score 
on the memory drawings to increase with advancing mental 
age. The results for patients with those diagnoses which 
show fairly large numbers of cases are given in Table 3. No 
figure is based upon less than five cases. 

TABLE 3 

Average Score on Memory Drawings For Different Diagnoses at 
Different Mental Ages 

(Highest Possible Score is 4) 
Diagnosis Mental Age 



N<»:inal Children 
"Not Insane" 
Fed^te-Minded 
Dementia Praecox 
Acute Alcohdic Psych. 
Manic-D^)re88ive 
All Hospital Cases 

From Table 3 it appears that the insane are well below 
normal children, " not insane," and feeble-minded of the same 
mental ages, but that scores tend to increase with advancing 
mental age. 
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When we group our cases by chronological ages we find, 
on the contrary, that the average score tends to drop off 
with advancing age, at least after age 40. The results are 
given in Table 4. 

TABLE 4 

Average Score on Memory Drawings For Different Diagnoses at 
Different Chrc»^logical Ages 

(Highest Possible Score is 4) 









ChixMiological Age 






10-19 20-29 30-39 40-49 50-59 60-69 70-79 


"Notlnsant" 


2.9 


2.9 










Feeble-Minded 


2.2 


1.6 


1.1 








Dementia Praecox 


1.4 


1.6 


2.0 


.9 


.7 


.0 


Syphilitic Psychoees 




.9 


.0 


.6 






Deteriorating Alcoholic 








1.8 


.3 




Acute Alcohdic 




1.6 


1.8 


.9 






Manic-Depre88ive 




2.0 


1.2 


2.0 


.6 


.5 


All Hoepital Cases 


2.3 


1.7 


1.4 


1.1 


.6 


.2 .1 



From the two tables just given we see that although cases 
with all diagnoses show increase in score on memory draw- 
ings with increase in mental age, and decrease in score with 
increase in chronological age after age twenty or thirty, there 
are, nevertheless, decided diflferences from diagnosis to diag- 
nosis as to the exact age at which the change begins or is most 
marked. When we come to the question of the disease itself, it 
is therefore necessary to reduce as far as possible the influence 
of mental and chronological age. In order to do this we 
have discarded those cases with mental ages below 11.5. 
This means that we have also eliminated practically all cases 
with chronological ages of 50 or more, for none of our older 
patients received high scores on the Point Scale. With such 
limitations we find the average scores on the test to be : cases 
diagnosed as "not insane," 2.9; normal children, 2.7; cases 
diagnosed as feeble-minded, 2.7; as dementia praecox, 2.1; 
as manic-depressive, 1.5; as acute alcoholic psychoses, 1.5; as 
deteriorating alcoholic psychoses, 1.4; as syphilitic psychoses, 
1.2; as unchssified paranoid condition, .8; and of those diag- 
nosed as arterio-sclerotic psychoses and senile dementia, there 
were too few cases. If further restriction is made by dis- 
carding all cases with chronological ages of over 30 we get 
the same order of diagnoses for the first six groups. TTie 
other groups drop out. The mean variations for these aver- 
ages are all about .9. 
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In the score for the drawings from memory, therefore, we 
find the first point at which the psychological examiner should 
be on the lookout for inc(Misistencies. Realizing that a high 
score is to be expected from young persons and from persons 
with a high mental age, the examiner should note any case 
where low chronological age and high mental age are com- 
bined with poor performance in the memory drawings. 

Not only is the score on the memory drawings important, 
but the shape and size of the drawing itself may be indi- 
cative of mental disease. A drawing which receives no credit 
may be as significant as one which adds to the total score. 
If we take the drawings which were not given any credit, 
we may arrange them in the following groups: those giving 
the correct drawing, but adding extra lines (e. g., in the first, 
the "box," drawing, when the diagonals were continued to 
meet within the inner rectangle, or in which there was more 
than one inner rectangle, or in the second drawing when two 
or more humps were made between the uprights) ; those giv- 
ing correct drawings except that they omitted a few lines; 
those giving very sketchy drawings (e. g., in the first, draw- 
ing merely one rectangle, in the second, drawing merely a 
jointed line) ; those making drawings which showed they had 
the general idea only (e. g., in the first, making a conven- 
tional box, or a rectangle with something inside, in the second, 
a horizontal line with curlicues or ornaments of some kind at 
the ends) ; those drawing things which showed practically no 
resemblance whatever to the original (e. g., a triangle for the 
first, or a circular figure for the second) ; and those making 
no attempt to draw the figures at all. The results we obtained 
from this grouping were significant but were so awkward 
to handle that we combined the groups into those giving the 
general idea (as above), those giving sketchy drawings (in- 
cluding also those who made no attempt, and those who 
omitted lines), and those giving elaborated drawings (in- 
cluding also those whose drawings showed no resemblance to 
the original). Our data give no evidence that mental age and 
chronological age have any influence on the type of memory 
drawing. The cases with the diflferent diagnoses, however, 
give rather typical results. When we consider only those 
cases with mental ages of 11.5 or more (so that any influence 
of mental or chronological age is even more certainly elim- 
inated) we find those inclined to elaborate or fabricate in the 
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drawings to be those suffering from s)rphilitic psychoses (43% 
elaborated vs 0% who give scanty drawings) ; from dementia 
praecox (24% elaborated vs 12% scanty) ; and from unclassi- 
fied paranoid condition (40% vs 30%). On the other hand, 
those tending to give scanty or sketchy drawings are: those 
suffering from deteriorating alcoholic psychoses (33% scanty 
vs 0% elaborated); and the feeble-minded (19% scanty vs 
5% elaborated). The cases diagnosed as "not insane" give 
less than 10% in either scanty or elaborated drawings. Illus- 
trations of such drawings are given in Plate 1. Figure (a) 
shows a sketchy drawing of the " box " made by a case of 
senile dementia, chronological age 75, mental age 7.5. Fig- 
ure (b) shows a slightly elaborated drawing of the first figure 
made by a case of dementia praecox, chronological age 22, 
mental age 11.2. Figure (c) shows practically no resemblance 
to the original " box " which the patient, a case of general 
paresis, chronological age 50, mental age 8.9, was attempting 
to reproduce. The other figures in the plate are reproductions 
of the second memory drawing. Figure (d) was made by 
a case of manic-depressive insanity, chronological age 30, 
mental age 18.0 and belongs, of course, to the " scanty " 
type. Figures (e) and (f) are examples of elaboration and 
were given by a case of dementia praecox, chronological age 
18, mental age 13.5 and by a case of general paresis, chrono- 
logical age 30, mental age 11.6. Figure (g) shows an entirely 
fanciful reproduction by a case of general paresis, chrono- 
logical age 41, mental age 8.9. 

Our main conclusions considering all computation of re- 
sults on both drawings, individually and together, cases with 
mental ages 11.5 or over, and all mental ages together, types 
of drawings as originally separated, and as grouped together, 
are these: Patients suffering from syphilitic psychoses, de- 
mentia praecox, and unclassified paranoid condition tend to 
elaborate the original drawing, or to make some fanciful com- 
bination of lines having little or no relation to the original. 
Cases of arterio-sclerotic psychoses and senile dementia are 
apt to fail to attempt the drawings at all. Cases of manic- 
depressive insanity, arterio-sclerotic psychoses and senile de- 
mentia are apt to omit lines. The feeble-minded omit lines 
more often than they add them. 

The size of the drawing from memory is probably also of 
significance. Patients are not instructed to reproduce the 
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drawings in any special size, though the size is roughly limited 
by the dimensions of the record sheet (10.5 in. by 7.5 in.). 
If a patient asks " Shall I make it just the same size as the 
one I saw?" he is told "Why, yes. Just about. You need 
not be too fussy." Very few patients ask. We shall confine 
ourselves to the discussion of the first drawing, since it is much 
the easier to measure, and we have observed that increase or 
decrease in the one drawing tends to carry over to another. 
The height of the original drawing is 4.4 cm. Our records 
give no evidence that mental and chronological age have any 
influence on the size of the drawings from memory. The 
average heights of the drawings given by patients are : those 
diagnosed as "not insane," the feeble-minded, and those suf- 
fering from deteriorating alcoholic psychoses, each 3.8; those 
suflFering from manic-depressive insanity, 4.1; from acute 
alcoholic psychoses, and from senile dementia, each 4.2 ; from 
arterio-sclerotic psychoses, and from unclassified paranoid 
condition, each 4.3; from demential praecox, 4.4; and from 
syphilitic psychoses, 5.3. (The mean variations of all these 
averages are about 1.0.) Similarly, if we consider the per- 
centage of cases giving extremely large or extremely small 
drawings, we find that the cases of syphilitic psychoses, of 
unclassified paranoid condition, and of dementia praecox tend 
to exaggerate the size ; while the feeble-minded and the cases 
of manic-depressive and alcoholic psychoses tend to diminish 
the size.* These groups are the same that we found in the 
discussion of the " types " of the drawings. Thus, roughly 
speaking, paucity of detail and relative smallness of size are 
found in one group of diagnoses, elaboration of detail and 
largeness of size in another group.^ 

We may sunmiarize our discussion of the drawings from 
memory as follows: The psychologist should note: (1) a 
low score on the drawings from memory combined with a 
comparatively low chronological age and a high mental age; 
(2) elaborated or fanciful drawings; and (3) very large 
drawings. 

^ In 370 examinations of rather low-grade normals which we have 
consulted in connection with another problem, the average height of 
the drawings was 33 ± A, 

^ It would be interesting if we could know how many of these 
patients show enlarged handwriting wider distraction, as in the work 
reported by June E. Downey on the "Will Profile," University of 
Wyoming BuUetin, Vol. XV, No. 6A, 1919. 
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Memory for Short Paragraphs 

In this part of the investigation we used the same records 
as in the discussion of the memory span. 

It appears from our results that the tests now to be con- 
sidered are highly significant.* The results for patients suf- 
fering from the various diseases at different mental ages where 
there were a fairly large number of cases are given in Table 5. 
In this table we have averaged the niunbers of details given 
in the three selections for the sake of simplicity and because 
there were no obvious variations in the results from selection 
to selection. 

TABLE 5 

Average Number of Detah^ Recalled in Paragraph Memory Tests 
BY Different Diagnoses at Different Mental Ages 



(Highest Possible Average is 17 . 3) 






Diagnosis 






Mental Age 








7-8 


9-10 11-12 13-14 15-16 17-18 18+ 


"Not Insane" 






8.7 


12.4 9.2 




12.3 


Feeble-Minded 


3.4 


6.7 


8.4 


11.6 






Dementia Praecox 


2.1 


4.7 


6.2 


7.0 8.6 


9.6 


10.0 


Alcoholic Psychoses 


3.3 


4.6 


7.0 


8.7 


9.5 


8.0 


Manic-Depressive 


3.4 


8.0 


6.0 




8.9 




Unclassified Paranoid 






6.2 


5.0 




9.7 


General P^esis 




6.6 








8.4 


All Hospital Cases 


2.7 


5.7 


7.3 


8.2 8.9 


9.8 


9.8 



In general, as in the drawings from memory, we find for 
each disease, as well as for all diseases grouped together, a 
tendency for the number of details to increase with an increase 
in mental age. We see, moreover, that the cases diagnosed as 
" not insane " are decidedly superior to the insane of the 
same mental age. This apparently means that memory de- 
teriorates or shows irregularities more quickly than intelligence 
at large. 

When we group the cases by diagnoses and by chronological 
ages, we have Table 6. 

^ Doubtless the test would be still more useful if each part were 
read to the subject, instead of having him read some of them alotsd 
himself. In all work with psychotic persons we find many patients 
with poor eyesight, and with scanty education. It seems dear that any 
difficulty with reading thus caused may constitute an unfair distraction 
and lower the score. 
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TABLE 6 

Average Number of Details Recalled in Paragraph Memory Tests 
BY Different Diachosbs at Different Chronological Ages 

(Highest Possible Average is 17.3) 
* Diagnosis Chroixdogkai Age 



10-19 20-29 30-39 40-^ 50-59 



"Not Insane" 11.5 9.8 9.8 8.4 

Feeble-Minded 9.0 7.5 5.6 4.5 

Dementia PraecQx 7.5 6.5 7.2 6.5 

Alcohdk P^ydioaes 7.4 7.3 6.4 

AU Hospital Cases 9.7 7.2 7.9 7.0 7.1 

In general we find here, as in the case of the drawings from 
memory, that the score in the paragraph memory test falls 
off with advancing chronological age. This is particularly 
marked in the case of the feeble-minded. 

Again, as in the earlier tests, we have endeavored to reduce 
as far as possible the influence of mental and chronological 
age by considering only those cases with a mental age of 11.5 
or more. When we do this we find the average number of 
details recalled to be: by the "not insane" cases, 10.1; by 
the feeble-minded, 10.0; by those suflFering from manic-de- 
pressive psychoses, 8.6; from dementia praecox and alcoholic 
psychoses, each 8.4; and from unclassified paranoid condi- 
tion, 7.8. We have here evidence of a tendency for the feeble- 
minded and the " not insane " cases to give more details than 
the psychotic patients of the same mental level. It will be 
remembered that by limiting our mental ages we limited the 
chronological ages to those tmder 50, but it is evident from 
Table 6 that the reduction in score with advancing chrono- 
logical age begins long before 50 is reached. If we reduce 
still further the influence of chronological age by considering, 
of our group over mental age 11.5, only those with a chrono- 
logical age under 30, we deplete the ranks to such an extent 
that only three groups remain. The average scores for these 
are : " not insane " cases, 10.7 ; the feeble-minded, 9.9 ; and 
patients suffering from dementia praecox, 7.9. 

We have shown that dementia praecox patients, and prob- 
ably other psychotic cases, give fewer details in the memory 
tests than do the "not insane" cases and the feeble-minded 
of the same mental age. We come now to the question of the 
number of errors made. By errors we mean such responses 
as " December " for " September," " tenement " for " house," 
etc. We find such errors for all ages and for all diagnoses. 
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The number of errors decreases slightly with advancing men- 
tal age, and apparently does not change with chronological 
age. Errors are least frequent among the " not insane " sub- 
jects, and most frequent among the dementia praecox and 
general paretic patients. Indeed, nearly half that the general 
paretics give is wrong. 

If we disregard such simple mistakes and consider merely 
the cases where the subject adds something which was not 
in the original, we find all except the feeble-minded making 
additions of some sort. In the case of the " not insane " the 
number is very small and all additions have a close connec- 
tion with the material which had been read. Some of the 
patients, however, give irrelevant material.^ Of the general 
paresis cases who had a mental age of 11.5 or more, 70 per 
cent gave additional or irrelevant details. Similarly 27 per 
cent of the cases of manic-depressive insanity (and all of these 
27 per cent were manic), 16 per cent of those suffering from 
alcoholic psychoses, and 4 per cent of dementia praecox 
patients give additional details. This list agrees for the most 
part with the list of those adding to the drawings from mem- 
ory. In the drawings we found the patients most likely to 
add to be those suffering from syphilitic psychoses (corre- 
sponding to the general paresis cases here), from unclassified 
paranoid condition (not represented here), from dementia 
praecox (as here), and from acute alcoholic psychoses (corre- 
sponding to the alcoholic psychoses here). 

In the memory for short paragraphs, therefore, as in the 
memory for drawings, the psychologist must watch for incon- 
sistencies between the mental and chronological ages and the 
score on the test, and for any cases which add details, par- 
ticularly those cases which add irrelevant matter. 

Conclusions 
1. There is no evidence that the insane give responses in 
the memory span for digits or sentences which are markedly 

^ Illustrations of what we mean by " irrelevant material " are given 
by two records, each taken from the examination of cases of general 
paresis. One reproduced the Hcaly Visual Verbal test beginning " If 
a man . . ."as follows: "The girl was burnt bad and he went 
and got firemen and he was burnt If he didn't report it, people 
who were there would have been burnt too." The other patient repro- 
duced tiie Hcaly Auditory Verbal selection beginning "If a sailor 
. . ." as follows: "There was a boy going to a ship, was always 
looking for water. Then he was looking for a cargo and looking out 
for trains going across." 
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dififerent from those given by normal persons of the same 
mental and chronological ages. 

2. The responses given by the insane in the tests for mem- 
ory drawings and memory for short paragraphs are less ade- 
quate than those given by the normal and the feeble-minded 
of the same mental and dironological ages. This is probably 
due to the fact that many of our insane cases suffer a de- 
teriorating or temporarily incapacitating process which, like 
increasing chronological age, affects memory to a greater ex- 
tent than it does intelligence at large. 

3. In certain types of insanity there are significant responses 
not indicated in the score, such as extreme size and irrelevant 
details in the case of the memory drawings, and numerous 
errors and additions in the reports of the paragraph selections. 

4. Table 7 summarizes some of the chief types of response 
which may be expected and which may be given some weight 
as diagnostic signs, for cases with high mental ages (at least 
11.5) and comparatively low chronological age (under 50). 



TABLE 7 
Drawings Paragraphs 


Diagnosis Score 

"Not Insane" 2.9 
Fed3le-Minded 2.7 
Dementia-Praecox 2 . 1 
Syphilitic Psychoses 1.2 
AlaSdic Psychoses 1.5 
Manic-Dqiressbe 1 . 5 
Unclassified Paranoid .8 


5 Siie Type 
in cm. 

3.8 Correct 
3.8 Correct 
4.4 Elaborated 
5.3 Elaborated 

4.0 Sketrhy 

4.1 Sketchy 
4.3 Elaborated 


Number of Irrele- 
Correct vant 
Details Additions 

10.1 None 
10.0 None 
8.4 Few 
(few) Many 
8.4 Few 
8.6 Some 
7.8 Few 
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(a) Senile dementia, chr. age, 75; mental age, 7.5. 

(b) Dementia praecox, chr. age, 22; mental age, 11.2. 

(c) General paresis, chr. age, 50; mental age, 8.9. 

(d) Manic-depressive (depressed), chr. age, 30; mental age, 18.0. 

(e) Dementia praecox, chr. age, 18; mental age, 13.5. 
(/) General paresis, chr. age, 30; mental age, 11.6. 
(g) General paresis, chr. age, 41; mental age, 8.9. 
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GENERAL INTELLIGENCE DETERMINED BY ITS 
WEAKEST ESSENTIAL ELEMENT 



By Bruce V. Mookb, Research Fellow, Caraegie Institute of 
Technology, Pittstrargh 



In the measurement of intelligence and the interpretation 
of results, we must have a workable theory, even though tenta- 
tive, of what it is that we are measuring or testing. We 
must have a practicable conception of the nature of general 
intelligence and the processes involved that meet the condi- 
tions of oiir particular tests. Ruml (3) has already dis- 
cussed the complications arising from inadequate attention 
being given to our assumptions and hypotheses in mental test- 
ing. The following quotations are pertinent : " Relative to 
the time and number of people devoted to work with mental 
tests, the results have been astonishingly meager in theoretical 
value. . . . Extensive collection of data through mental 
tests began without the necessary antecedent and contempor- 
aneous development of point of view, hammering out of con- 
tradictions in concepts and hypotheses, and elimination of 
ambiguities in common everyday words and ideas. . 
It is probable that many of the failures of mental tests can 
be traced to our present inadequate theoretical foundations." 

Opposing theories have been set forth. Spearman (6) (7) 
would use those tests for determining general intelligence 
which have the highest correlation with each other. His 
theory of a " General Intelligence Factor " or " Intellective 
Energy " and a hierarchy of special mental abilities with the 
rank of each depending upon the relative amounts of the gen- 
eral factor in each special ability, was based largely on the 
high correlation among some mental abilities as shown by 
tests. Thompson (10) has shown that Spearman's results 
may not be due to a general factor. According to Spear- 
man's theory, it would be logical to believe that to test a gen- 
eral factor of intelligence entering into special abilities, we 
should use those tests showing a high correlation due to the 
presence of this common factor. 

Stem (9) has presented a different view as follows : " We 
must combine together tests that correlate less with one an- 
other than each one of them correlates with estimated intelli- 
gence, and that combination whose amalgamated rank-order 
shows the highest and most consistent correlation with esti- 
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mated intelligence is the system of tests that we seek." The 
theory underlying this statement has been set forth by Thorn- 
dike (11). General intelligence is composed of a large group 
of factors or abilities ; and instead of distinct types of intellect 
and character, there is a gradation around " one-mediocrity." 
"In our ratings of men we unconsciously strike a sort of 
average of his abilities in learning, thinking, and acting. The 
source or cause of this average ability is what we really have 
in mind when we speak of his intelligence." (12) 

Various other investigators have contributed to the discus- 
sion and facts concerning general intelligence.* All the 

1 Wells (14) gives a warning in stating that we may give the same 
test to two people and yet not test the same thing. " Because Peter 
is ten per cent better in memory test than Paul, does not say that it 
is due to a ten per cent superiority in the same abilities as Paul's." 
(Italics mine.) He considers general intelligence as mental capacity 
for adaptation to life, and states that some mental factors most 
important for this adaptation and success in life are not reached even 
by Binet tests. "The regularity with which a voluntary task is per- 
formed, the attentional control over it, and its freedom from subjective 
interference are more important to observe than the absolute efficiency 
in some task." 

Burt (2) gave a variety of tests to about a hundred subjects, and 
in discussing the results he states that the rank order of the tests 
according to the attention required corresponds* fairly closely to the 
order of correlation with intelligence and with the hierarchy. He states 
further : ** It is one feature or function of attentive consciousness 
in particular which forms the basis of intelligence — ^namely, the power 
of readjustment to relatively novel situations by organising new psycho- 
physical co-ordinations. . . . High intelligence seems to mean high 
capacity for continually systematising mental behavior by forming new 
psycho-physical co-ordinations, older co-ordinations being retained." 

Brown (1) states from his results that correlations may be very 
low even within a set of mental tests which appear to measure closely 
related mental abilities. Also, ** in homogeneous groups of subjects 
there is no positive evidence of the existence of one 'central factor* 
to which the correlations between the individual mental abilities may 
be regarded as due." 

Simpson (5) concludes from his results: (a) "We may well look 
to language tests in some form to furnish good tests o{ general in- 
telligence, (b) There is "justification for the common assumption 
that there is close inter-relation among certain mental abilities, and 
consequently a something that may be called 'general intelligence': 
and that on the other hand certain capacities are relatively specialized, 
and do not necessarily imply other abilities except to a limited extent." 
(c) There is " no justification for the view that ' general intelligence ' 
is to be explained on the basis of a hierarchy of mentel functions, the 
amount of accuracy in each case being due to the degree of con- 
nection with a common factor" (in Spearman's sense), (d) Tests 
most intimately related to other abilities are selective thinking, mem- 
ory and association, quickness and accuracy of perception, motor con- 
trol, and sensory discrimination, each in the order named. 
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results and hypotheses might be considered as indices of 
the nature of general intelligence; but it is difficult to bring 
them together into a consistent conception of general intelli- 
gence that will in turn help us interpret them. We accept 
Thomdike's theory of a multiplicity of abilities with varia- 
tions around a single type of * one-mediocrity ' as the most 
consistent with the facts; and it seems to be coming into 
general acceptance. Taking this theory as a basis, we shall 
try to elaborate a working conception that will help us under- 
stand the facts, and act as a basis for further study. This 
conception is presented most easily in diagrammatic form; 
but first we shall state some of the premises. 

The numberless neurones combined into many situation- 
response units have still further numberless possible com- 
binations and permutations ; but they tend to become grouped 
and function in the form of what we discriminate as particular 
abilities. This integrative action of the nervous system is 
clearly described by Sherrington (4). It was also referred to 
by Burt, quoted in the note above. Consciousness at any 
moment, then, usually involves several empirically analyzable 
functions or abilities, such as memory, association, or rather 
such as memory of the multiplication table, discrimination of 
the meaning of the words in a problem in multiplication 
before us, the association of the problem with processes of 
multiplication, etc. At different times, different functions 
or abilities are emphasized or used. Related abilities, — that is, 
certain related groups of neurones, — ^are aroused also, and are 
either used or are ready for use. The state of consciousness 
might be compared to a correlation surface or a group of 
mountains with the clearest consciousness represented by the 
highest peak in the center and the associated foot-hills grouped 
arotmd it and being smaller the farther they are away from 
the focus of consciousness. It might be compared better to 
the surface of a body of water in which the highest wave 
was the center of consciousness, which was always shifting 
its position. General intelligence consists of a multiplicity of 
abilities, or the capability of functioning of several empirically 
or experimentally analyzable functions or abilities. The many 
abilities tend to act as a whole, and many are involved in all 
states of consciousness. For example, if there were no mem- 
ory, or more strictly speaking, absolutely no retentiveness in 
any individual, it is difficult to conceive how there could be 
any intelligence. The intrinsic capacities or potentialities of 
the various functions or abilities are fixed and unchangeable. 



Digitized by 



Google 



158 MOORE 

although the focus of consciousness playing over them is con- 
stantly shifting its emphasis from one function to another. 

As we now test general intelligence, we may not, and prob- 
ably do not test the capacity of the total multiplicity of abili- 
ties. We test those that correlate with estimated intelligence, 
which is general adaptability to environment and ability to get 
along most satisfactorily in this life as now ordered. We 
tend to emphasize the importance of the higher processes and 
test them as representative of intelligence. By higher pro- 
cesses we mean those that have a greater complexity of struc- 
ture or integration, and have been formed latest in fiie process 
of evolution. As these higher abilities are more newly formed 
and less stable processes, they are somewhat limited in any 
individual, and are not so common in society. Thus, they 
are at a premium in the world of action. Their limitations 
in each particular mind mark the limitations of general intelli- 
gence in that individual. The lower order abilities are needed, 
doubtless, to make up general intelligence, but being developed 
earlier, they are more stable, their capacities or possibilities 
are greater, and they seldom limit general intelligence by not 
being able to contribute their proportionate part necessary for 
general intelligence. They are not less in capacity or per- 
fection than the higher abilities ; they are probably more able 
to fill their place in general intelligence. But general intelli- 
gence can never be greater than the limit set by any necessary 
factor, ability, or group of neurones when this factor has 
reached its particular maximum of efficiency in its part of 
general intelligence. In this respect, general intelligence is 
similar to a chain, which is no stronger than its weakest link. 
Though there be some compensation or vicarious functioning, 
it is not necessary for all elements to be weak to weaken gen- 
eral intelligence. However, most functions have a larger 
capacity or possibility of function than that required by the 
maximum of general intelligence, since general intelligence 
is limited by some relatively weak ability. In such cases a 
measure of general intelligence as it is commonly made does 
not give a picture of the total mental capacity. Only a psy- 
chogram representing the individual capacity of each special 
ability isolated and measured would give us the total picture. 
Moreover, by measuring special abilities, we get individual 
differences, and can thus differentiate individuals; but we 
are not sure that these differences are differences in general 
intelligence. It is conceivable that a factor or ability most 
essential to general intelligence in that it is predominant in 
quantity, might correlate very little with general intelligence, 
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if it has capacity still greater than its essential contribution 
to general intelligence requires. Thus a simple factor which 
Ic^cally seems essential to general intelligence, when tested, 
often shows little correlation with intelligence. This con- 
ception may explain some of the unexpected correlations and 
unexpected lack of correlations in the results of various in- 
vestigators. Individual differences in the capacities of special 
functions may hide or make indistinguishable the correlations 
with general intelligence of special functions tested. The 
exaggerated development of any particular special capacities 
may not increase their contribution to general intelligence in 
the same proportion ; that is, it may minimize their importance 
relative to their exaggerated size, and thus minimize their 
correlation with general intelligence. The rank of some 
functions would be lowered and the rank of others raised, 
so that a " hierarchy of functions " might be or might not 
be made to appear. There is not a hierarchy of functions, 
except as they may be grouped; and there is not a common 
element, except as they are similar in that they are related 
in some way. There may be a common element in similarity 
of modifiability or in ability to function, which in cumulation 
determines general intelligence. General intelligence can be 
measured not necessarily by its most common function or ele- 
ment, or the one contributing the greater proportion, but by 
the one whose maximum possibility is required. A more com- 
plete picture would be, of course, a psychograph of its factors. 
This conception is presented diagrammatically on page 160. 
The extent or length of the x-ordinate or base of the diagram 
represents the extent of qualitative variety or the multiplicity 
of abilities of the total capacity of an individual. The height 
of the diagram of any particular part represents the quanti- 
tative aspect or the amount of any particular ability. The 
small figures or curves on the base line are diagrammatic 
representations of neurones, or rather groups of neurones 
which function as the physiological elements of the particular 
abilities. A few of the particular abilities are diagrammatically 
represented by the curves similar to frequency curves. Gen- 
eral intelligence might be represented by the dotted line touch- 
ing the tips of the particular abilities entering into general 
intelligence as it is usually considered. The measure of gen- 
eral intelligence might more consistently be represented by 
the elevation of a straight line drawn so as to just touch the 
top of the curve of the weakest necessary ability. The broken 
line represents the total capacity of the mind as it might be 
{otmd to be by a complete survey for a psychograph. The 
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high peak in the center would indicate that this particular 
individual was a mathematical genius. A test of his mathe- 
matical ability would differentiate him from other individuab, 
but would not represent his general intelligence, which was 
determined by his weakest ability necessary for general intelli- 
gence. The completion test would be a good measure of his 
general intelligence. The diagram might be three dimensional 
in the form of a correlation surface appearing as a group of 
mountains and hills of particular abilities. 
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EFFECTS OF VARIOUS MODES OF PUBLIC 
READING^ 



By Charles H. Woolbert, Ph. D. 



This study is an attempt to bring the ntunerous problems 
of oral expression and public reading into the laboratory. 
For the beginnings of such an experiment the most promising 
place is the laboratory of psychology inasmuch as speech is 
intended to reach the minds of auditors who are expected to 
react to the stimulation furnished by the voice of the speaker 
or reader. Thus the problem deals with auditory stimulations 
and with behavior activities of listeners. The task to be met 
is that of finding a method whereby the stimuli can be con- 
trolled and receptivity measured; that is, of insuring an ade- 
quate description of the effect of the voice of the speaker or 
reader upon the responses of the auditors. 

The method adopted after many preliminaries was based 
upon a study of the relation between changes in the use of 
the voice and specified responses of auditors; that is, the 
effects of various modes of public reading, employing dif- 
ferent combinations of changes in the use of the attributes 
of sound while reading. These different combinations oflFer 
various modes of reading. The attributes of sound are pitch, 
intensity, time, and timbre (sometimes called quality when 
applied to the voice). While all speech that is meaningful 
to auditors employs constant changes in the use of these four 
attributes, still there are no results obtained under laboratory 
conditions that show which are most significant or what rela- 
tion they bear to each other. A restricted series of modes 
of reading was selected for use throughout the study, limited 
to certain gross degrees of change in pitch, time, intensity, 
and timbre. A description of these modes together with the 
method of evaluating results from their use, is given later. 

Changes in pitch, time, intensity, and timbre can be studied 
as general and total or as finely modulated and of narrow 
degree. Again they can be studied as affecting individual 
words, sentences, paragraphs, or larger units of discourse. 

^From the Psychological Laboratory, Harvard University. 

162 



Digitized by 



Google 



EFFECTS OF MODES OF PUBLIC READING 163 

The type of change studied here applies to large units of dis- 
course, in this case passages of twenty minutes in length. No 
attention is here paid to the modulations occurring between 
words, or sentences, or units of small measure. A certain 
"tone of voice" is selected and used throughout a twenty- 
minute passage. 

The Attributes of Sound as Elements of Change in 

Reading 

Pitch Changes. When employing changes in Pitch as the 
basis of investigation, it is necessary to hold in mind that 
these are of at least three different kinds: (1) the slide within 
the individual syllable, (2) the step from one syllable to the 
next, and (3) the general pitch level on which a passage or 
a composition is uttered. The first two are continual changes 
required in normal speech ; the last change is only occasional. 
When change of pitch is referred to in this paper, change of 
the slide within the syllable and from one syllable to the next 
is intended. 

Time Changes, Changes in time are chiefly in the length 
of the vowel parts of words, i. e., the tonal part as against 
noises. "Gauthiot's* records show that there are two main 
classes of vowels in respect to duration, long and short, whose 
average lengths bear the remarkably constant relation of 4 :2.*' 

Changes in Pause. A cause of the frequency of duration 
change is that pauses must be included. Pauses — ^periods of 
silence — are necessary because of (1) the need of a break 
between syllables and words, and (2) because of the demands 
of breathing. Accordingly ,in speaking here of changes in 
time we always include changes in pause; pauses between 
syllables, words, phrases, clauses, sentences, and the major 
divisions of composition. 

Intensity Changes. Changes in tone intensity are also very 
common owing to the fact that accentuation is not possible, 
in English, without a change in intensity on the accented 
syllable; for accent, in this language at least, is largely a 
matter of a rise in pitch and an increased energy of utterance. 
Also emphasis, as distinguished from accent, is almost always 
accompanied by an increase or decrease in intensity. 

Qualitative Changes. Changes in quality (timbre) are least 
common of all. Changes in quality are probably more influ- 
ential than any other t3rpe of change in revealing the emotional 

'Gauthiot, Dc Tacccnt et de la quantite en literanien, La Parole, 
1900, II., 143. (Cited by Scripture.) 
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state of the speaker. Emotional states involve muscular and 
vascular changes in the throat and pharynx, and thus the body 
of overtones is greatly affected in number and intensity, pro- 
ducing attention changes in quality.* 

Overlapping Effect of the Four Attributes. In every man- 
ner of reading that involves a maximal change of one of the 
elements, there is a certain amount of overlapping. When 
the extremes of change in pitch are used, there is a necessary 
change in quality. Very high notes, lacking certain overtones, 
produce a different quality impression from tones possessing 
these overtones. A prolonged tone, especially a tone of speech 
necessarily involving a slide, tends to carry tfie slide on during 
the prolongation, thus involving a change in quality. A tone 
of strong intensity is kept loud most easily by being also 
high in pitch. Tones of "chest resonance" are prevailingly 
lower in pitch than those of "head" quality; at least 5ie 
majority of people find it easier to form them in these com- 
binations. 

By isolating one attribute at a time, giving it an extreme 
degree of change while holding the others at a median degree, 
we get 4 modes of reading ; by doing the same with no change 
of each of the attributes we get 4 more modes; by using a 
median change of all 4 we get another; by using an extreme 
degree of all four we add one more; and, finally, by em- 
ploying no change at all in any of the attributes we ad4 the 
last; making in all 11 modes of reading. These represent 
only gross situations, and so are capable of control at the 
hands of a trained reader. Following is a specific designa- 
tion of each of these modes: 

Mode 1 : Median change of all four attributes. 

Mode 2 : Extreme change of Pitch ; Median change of other 
three. 

Mode 3 : No change of Pitch ; Median change of other three. 

Mode 4 : No change of Time ; Median change of other three. 

Mode 5 : Extreme change of Time ; Median change of other 
three. 

Mode 6 : No change of Intensity : Median change of other 
three. 

Mode 7: Extreme change of Intensity; Median change of 
other three. 

Mode 8: No change of Quality; Median change of other 
three. 

3 Blanton, S. Quart. Jour, of Public Speaking, Vol. II. " The Voice 
and the Ejmotions." 
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Mode 9: Extreme change of Quality; Median change of 
other three. 

Mode 10 : Extreme change of All Four Attributes. 
Mode 11 : No change in any of Four Attributes. 

Modes of Reading 

Mode I. Median Change of All Attributes. In this mode 
all changes are of a median degree, but are constant in all 
four of the attributes of sound. Extremes of all kinds are 
avoided. The general effect of this type of reading is that 
produced by a congregation reading a Psalm in unison. There 
is a lack of what might be called " brightness," " animation," 
"alertness." In general it would be called rather dull read- 
ing, yet far from unintelligible and not at all bizarre or 
unusual. 

Mode 2. Extreme Change of Pitch.^ In this mode the 
voice travels to extremes of height and depth continuously, 
in the use of the slide on the syllable and in the step from 
syllable to syllable. Changes are extreme not only in dis- 
tance on the scale of pitch, but are frequent in occurrence, 
no passage of more than three or four syllables being without 
its abrupt and wide change. This mode is not altogether 
removed from meaningful and intelligible speech; for not a 
few^sentences resemble a type of speaking frequently heard 
in public address and in private conversation. Yet the con- 
tinual shifting of the voice up and down to extreme depths 
and heights produces an effect of monotony that is marked. 

Mode 3. No Change of Pitch, In this mode the reader 
eliminates all inflection of the voice upwards or downwards 
on the scale whether in slide, step, or general level. In the 
first place, the level is approximately at the middle height of 
the reader's range. Then, all slides also were eliminated, 
and likewise the steps; so that every sound was of the same 
level as every other sound. This type of reading is far 
from meaningless and is by no means strange to listeners 
who are accustomed to the intoning " customs used by cer- 
tain ecclesiastical sects. 

Mode 4. No Change of Time, In mode 4 every syllable 
was rendered with the same duration as every other syllable. 
Moreover, the pauses were of the same length, exception 
being made when breath had to be taken. A manner of 
speech employed by certain foreigners in learning the Eng- 

^A characterization like this assumes, it is to be remembered, a 
median degree of change of the other four attributes. 
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lish language approximates this; also, some speakers in their 
anxiety to be distinct use this mode. A most noticeable effect 
is the staccato involved. This mode, though, is not without 
meaningful emphasis, inasmuch as the emphasis of slide and 
intensity are retained to a median degree. 

Mode 5. Extreme Change of Time, Widely varying de- 
grees of change in time were applied not only to the vowel 
sounds, but to the pauses. Still the prolongations in this 
mode were not so great as is sometimes heard on the stage 
and in impassioned speaking, where with such an extreme 
manner must go a wide range of pitch or an amplification of 
the quality or an increase in the intensity that would con- 
stitute an error in the use of the median range of these three 
demanded by the premises. This is a relatively conunon 
mode; "animated" conversation is almost always maiicedly 
broken in time. 

Mode 6. No Change of Intensity, Reading on one level 
of intensity encounters a difficulty, in that there is need of 
eliminating all intensity factors from accentuation; and that 
is not easy. When all syllables must be made equally loud, 
accent disappears. Thus, choice had to be made lietween 
making unaccented sounds louder or accented sounds quieter. 
The latter alternative was chosen, for the reason that other- 
wise the whole effect would be merely that of blatant shouting. 
As a consequence, the reading in this mode gave the impression 
that the reader was very tired or uninterested in his task. 
Also when such accentuation by intensity change is eliminated, 
the listeners get the impression that the words are not being 
pronounced correctly and so reveal distress at first sound of 
the mode. Later they seem to be relieved. 

Mode 7. Extreme Change of Intensity, The simple 
formula for describing this mode of reading is to state that 
the sounds that in " normal " speech are the loudest are here 
made very loud; those that are of a median deg^ree of loud- 
ness ordinarily are made loud; the sounds of least intensity 
in every-day speech remain about the same, for they are 
merely audible then and cannot suffer lowering of intensity 
without disap|>earance. Listeners seemed to be benumbed 
by this manner. 

Mode 8, No Change of Quality. To accomplish this, one 
system of resonance, or complexity of sound, had to be decided 
upon arbitrarily from the several possible in the use of a 
trained voice. The quality chosen is that known as " oral " 
in terms of elocution. It is a quality that derives its resonance 
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chiefly from the bones high in the head. It is rich in high 
overtones, but poor in the lower ones that add much to 
impressiveness in speech. All resonance from the "circle 
of the pharynx " is reduced to a minimum, if not eliminated 
altogether. The effect of this manner is to make the reader 
appear sick or weak. 

Mode p. Extreme Change of Quality, In this mode vari- 
ous complexities of tone are produced by " placing " the voice 
so that there is a continual change in the various resonance- 
producing chambers of the head, throat, and chest. The 
effect is what is loosely called a continuing change of " emo- 
tional" tone. This makes it a rather common manner of 
speaking. It carries the virtue of " interestingness." 

M^de 10. Extreme Change of All Four Attributes. Here 
we have the mode that makes variation its chief quality. If 
variation may be predicated a priori as a value in reading, 
then this ought to prove an impressive and an interesting 
manner. Every kind of change is employed and in profusion. 
No one kind of change or lack of change was employed for 
any length of time. While great variety of change prevailed, 
yet only those changes were chosen which the reader thought 
were in conformity with the social speech habits of the ty|>e 
of auditors who served for subjects. It is a mode that 
empirically would be judged effective in making common- 
place statements interesting and easy to listen to. 

Mode II. No Change in Any of the Four Attributes. This 
manner involved complete uniformity of pitch, time, intensity, 
and quality — the extreme of monotony. It inhibits the ap- 
prehension of the logical meanings of word-sounds. When 
all syllables are given the same duration and the same in- 
tensity, in addition to monotony of pitch and absence of 
change of quality, the listeners seem to have difficulty in 
catching the words. Yet this applies at the beginning of 
the reading more than later. 

The Reading 
The reader made no attempt to add to the effectiveness 
of his reading by any other means than the use of the voice. 
No gestures, postures, or facial expressions were intended; 
all such devices for inducing responses were scrupulously 
and successfully, it is fair to say, eliminated. Sitting com- 
fortably in his chair, most of the time leaning back, though 
occasionally leaning forward on the desk for relaxation, he 
read in the manner he had prescribed for the day's reading. 
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At the close of the reading the reader shut the book, and 
announced that that was all for that reading. Then an in- 
terval of a few minutes was allowed, varying from two min- 
utes to five. During this interim the experimenter wrote on 
the blackboard the title of the second story to be read during 
the next half of the period, together with the names of the 
characters that appeared in that story. The auditors were free 
to move about the room or to remain in their seats. The 
only prohibition put upon them was that they must not talk 
about the story just read or about the characters in it or about 
stories of which it reminded them. In fact they were pre- 
vented from making any reference or allusion to it that might 
establish or strengthen associations. 

At the close of the second reading, the experimenter passed 
out the papers on which the reports were to be written. These 
papers were folded, numbered on the back, and dated with 
the date on which they were to be filled in. Subjects were 
instructed not to unfold them, and under no circumstances 
to look at the contents until ready to write out their report. 
The papers were presented in such a way that there was 
no occasion for looking at their contents. There is every 
reason to believe that this instruction was carried out to the 
letter. When the papers had been given out, all the auditors 
left the room. 

Length of Reading, The reader stopped arbitrarily at the 
close of the twenty minutes. With two readings a week for 
each subject and with two readings a meeting, a large number 
of stories had a place in the ex|>eriment. 

The reports were returned to the experimenter any time 
after the fifth day. 

Reports 

Purpose. The purpose of the reports is to provide a meas- 
ure of impressiveness of the different modes of reading, and 
to give this measure in mathematical terms. To do this re- 
quired a new method with very little precedent as guide. 

Tentative Method of Completion Test. In the first test to 
measure retentiveness of impression according to modes of 
reading, the subject was merely asked to write down what 
he remembered. No restrictions were placed upon the amount 
to be written, whether a brief summary or an extended nar- 
rative. As a consequence the reports differed so widely in 
the number of words employed and in minuteness of detail 
that they were not at all comparable. 
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Method Revised Further, To remedy this, a fixed schedule 
of instructions was given the subjects, as follows : 

1. Identify and characterize the different personages. 

2. Describe briefly the places pictured. 

3. Give a consecutive account of the events of the narrative. 

4. Outline the conversations given. 

Again the differences in the fulness of the reports of 
subjects were too great to make the results at all comparable ; 
some subjects wrote volubly on these points, others in the 
most laconic manner possible. So this device was abandoned. 

Method Finally Chosen, To remedy this defect, the system 
of " leads " was adopted. The " lead " is a partial or com- 
plete declarative sentence so selected that it brings to the 
observer some situation incident, or fact concerning the story. 
When the sentence is incomplete, then there is placed in 
parentheses some instruction as to what to do to complete the 
sentence. If the sentence is complete, however, then in the 
parentheses is given some instruction as to the offering of 
details, consequences, or characterization. Following is a 
sample of the type of " leads " used in the experiment : 

THE INN 
The inn of which we speak possesses many attractions (name 6). 
The present proprietor is Naum (describe him). 
The previous proprietor had been Akim (describe him). 
Akim kept the inn (how?). 

The land belongs to Elizaveta Kuntz (characterize her). 
Relate the affair between Akim and Dwiyasha, the servant 

Another example of this type of " lead " : 

FATHERS AND CHILDREN 

The governor in the narrative was to be investigated (for what?). 

Matyei, sent to investigate, was (characterize). 

Ma^ei stunned his subordinates in the characteristic Russian way 
<how?). 

Sitnikoff the dilettanti took them to the home of Madame Kukshin 
{describe her). 

The present domestic status of Madame K. was (what?). 

The three men were induced to go by (what promise?). 

Madame Kukshin talked of (detail her interests, using proper names). 

LIEUTENANT ERGUNOFF 

The Lieutenant was treated by the ladies from Riga (how?), (give 
specific details). 

One day the Lieutenant, wearied by (what?), (did what and with 
-what results?). 

The next day the Lieutenant received a letter (give contents). 

Upon his arrival next day (describe his welcome). 

(Then what happened? Relate in detail.) 

(Give a visual and an auditory picture of the " Humming-Bird.") 
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Leads 
Some Problems Involved, In devising leads several con- 
siderations have to be kept in mind, in order to make the 
data comparable: 

(1) Nothing subjective was asked for beyond interpreta- 
tions as to character and the meaning of events in the story. 
In the preliminary stages of the use of this method occasional 
descriptions and characterizations were demanded ; but results 
demcmstrated that individual differences in responding to such, 
leads were so great that the results of the various subjects 
could not be compared. 

(2) The matter asked for in the leads was uniformly con- 
crete. 

(3) Leading questions, those that can be answered with 
Yes, or No, were entirely eliminated. Also questions were 
so devised as to make difficult the inferring of the answer 
from the nature of the question. 

(4) The leads were chosen in such a way that the total 
effect of them was to produce a running summary of the story 
in its chief details. 

Number of Leads. According to this method there is no 
fixed number of leads for a report. In fact, the limiting 
of the number of leads to some specified figure would bring" 
an error into the records, for the reason that there are dif- 
ferences in style from one story to another of enough signifi- 
cance to make necessary a flexible joint in the method. Thus 
the choosing of the number of leads is entirely a matter 
determined by the nature of each story or passage. Espe- 
cially determinative of the flexibility is the matter of concrete- 
ness in the passage. In particular, events in time make 
serviceable material for leads. The number of leads pre- 
sented on reports differs from 8 to 35. 

Scoring 
. Determining the Value of a Pmnt. In general every 
recorded perception of a process was counted a point. Then 
when characterizations were demanded, if the number of 
these was specified, the fixing of the value of a point was a 
function of the number demanded; if the number was not 
called for, the experimenter had to decide what kind of answer 
constituted a point. In general a "point" is to be defined 
here as a recorded fact of an event, a characterization, or 
a description. As nothing but objective matter was asked for,. 
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the factual basis of points made scoring reports reasonably 
accurate and uniform. 

Specific Answer, The answer to the lead must satisfy the 
specific question involved before any credit at all is given. 

No Overlapping. The number of points pven any specified 
lead must be only such as are needed to tell the facts called 
for without overlapping. 

Essential Details. Only such details as are essential to the 
event, characterization, or description are accepted. 

Verbosity vs. Conciseness. Neither verbosity nor concise- 
ness are determining factors in scoring points. Some reporters 
are habitually wordy, others are by habit laconic Regard 
must be had for this difference in estimating the number of 
points to be scored. A single word can carry the evidence 
that the reporter has retained the essential fact while sen- 
tences may be employed by another reporter without adding 
to the evidence for retention. This was kept in mind con- 
sistently in making out the scores. 

Lack of Specificity in Answers. No credit is given for 
statements that do not specifically answer the question asked. 

Guesses. Subjects are warned against offering guesses; 
they are encouraged to leave blanks rather than make replies 
the correctness of which they cannot substantiate. The im- 
portant consideration in the understanding of their task is 
that they are not to make guessing a practice for the sake of 
shielding themselves from the effort necessary to answer with 
assurance, or for the sake of a full report. 

The Total Score. The total score for a report is a fraction 
which uses the whole number of points assigned to that 
report for a denominator and the total nimiter of points 
scored for a numerator. For purposes of uniformity this 
fraction is treated in the results on a percentage basis. 

Mechanism of Scoring. As a measure for stabilizing the 
judgment of the scorer, all scoring was done with the reports 
of one selected painstaking subject as guide. 

The first step in scoring is to estimate each lead separately, 
to determine how many points are needed to represent full 
retention for this lead. The number thus secured is then 
placed beside the lead at the left side of the paper. After 
all of the leads have been thus estimated, the total is found 
and set down at the top of the sheet for the denominator. 
The score of the paper, however, is not yet settled finally; 
two or three more papers are graded on this basis before 
arriving at a final judgment as to the weight of each lead and 
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SO of the size of the denominator. This reading of additional 
reports sometimes shows errors in the preliminary judgment, 
or reveals that the replies in the report of the guide auditor 
are not precisely representative. Revision is then made of 
those thus far graded, and with the revised denominator as 
a final judgment the scores are made out for all the reports 
and entered at the top of each sheet both as a fraction and 
as a decimal. 

A TYPICAL REPORT GRADED 

Reading A2 

WroE Range of Pitch 

MUMU 

(Vol. 2, to p. 218) 

(2) IN MOSCOW LIVED WITH her retainers and 

2 a Russian mistress (widow) servants 

(5) AMONG THEM WAS GERASIM WHOSE DUTIES 
WERE (SPECIFY FULLY) 

3 to sweep out the courtyard/fetch water/and generally 
guard the premises/ 

(3) GERASIM HAD PROVED HIS COMPETENCE BY 

(SPECIFY THREE DEEDS) 

3 not letting any dirt appear in the yard/if the cart for 

fetching water stuck in the mud he extricated it by his 
own strength/knocking the heads of two hapless rob- 
bers together/ 

(4) IN CONVERSATION WITH GAVRILA THE MIS- 

TRESS DECIDED TO 
3 marry off one of her dependents, a drunkard/in the 

hope of reforming him/and settle on Tatyana as his 
destined wife/ 

(3) GERASIM'S COURTSHIP OF TATYANA HAD 

CONSISTED OF (3 ITEMS) 
2 presenting her with little tokens as she passed him in 

the courtyard/not permitting her to be made sport of 
in his presence/ 

(2) THE MISTRESS UPON HEARING OF GERASIM'S 

COURTSHIP WAS 
I did not think the Mistress knew anything of Gera- 

sim's courtship. 
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(3) KAPITON'S REPLY TO GAVRILA CONCERNING 

TATYANA WAS 
3 that he would undoubtedly be killed by Gerasim/but 

that he was always doomed to ill luck/and might as 
well marry. He liked Tatyana herself/ 
(2) THE EFFECT OF THE COURTSHIP UPON TAT- 

YANA WAS 
2 merely to frighten her to death/and to acquiesce in 

the courtship for that reason/ 

Score— 18/24; .75 

Significance of Symbols, The capital letters used as desig- 
nations of the readings represent the mode in which the read- 
ing is done. (pp. 126-7.) The Arabic numerals used in 
connection with the capital letter represent readings 1 and 2, 
the first and the second respectively during the hour of meet- 
ing. The text in capital letters represents the leads given 
out on the reports; the rest of the text is the answers given 
by the subjects. The Arabic numerals in parentheses at the 
left represent the total number of points allowed to the lead 
beside which they are placed ; the numerals not in parentheses 
are the score given to the answer. The fraction at the bottom 
of the report represents the total score, which is also given 
as a decimal. The use of the bar (/) in the answers marks 
the division into points ; they are inserted to indicate the basis 
of marking off into points. 

Preliminary Discussion 

Constant Factors. The attempt was made in this experi- 
ment to keep the conditions as similar as possible to the con- 
ditions which prevail in places of public meeting. The typical 
" audience " was of three, occasionally a fourth being present, 
and at rare intervals five. Audiences of two were very few 
in the total number of tests. 

Thus the social environment of an audience was achieved 
in all cases. The tests were held in Room 27, Emerson Hall, 
Harvard University. Except when the hour was the first in 
the morning and subjects showed a tendency to straggle in 
as when going to public places, they gathered in the corridor 
outside the room ; they were instructed not to enter until the 
whole group had gathered, or to take their seats and comport 
themselves in the manner usual to them in going into a place 
of public meeting. Then as soon as all were in their places, 
the experimenter took charge of the meeting and directed the 
activities of the subjects from the platform. 
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Instructions, The experimenter then read the following 
instructions : 

1. ''Attend as you are in the habit of attending at public 
gatherings. 

2. "At the close of the hours you will pass out without being 
called upon for a report or discussion of the content of the 
reading. 

3. ** On the fifth day after the reading, and not before or 
later, you are to fill out a blank prepared by the experimenter, 
which will be placed in your hands at the close of the hour. 

4. " No feats of memory are sought, and no penalty or re- 
ward attaches to the amount you remember ; merely set down 
at the time of reporting what you have retained. 

5. "Keep the conditions of reporting as uniform as pos- 
sible ; use the same time of day, the same working surround- 
ings, the same place, the same amount of time, the same degree 
of care, and the same degree of effort to recall." 

During the early tests these instructions were repeated at 
the beginning of each period; later, paraphrases were given 
carrying the same implications; while still later nothing more 
was said as to instructions other than to remind the company 
that the instructions were the same as before. The sub- 
jects were repeatedly instructed that they were to listen as 
they are in the habit of listening when out in a place of 
public meeting, and that they were not called upon for feats 
of memory; they were merely to listen as they do usually, 
and to return an honest report written under circumstances 
uniformly the same. 

The Choice of Reading Matter, The choice of reading 
matter for this kind of experiment offers several nice prob- 
lems. In the first place, the matter must be unfamiliar to the 
auditors; secondly, the reading matter must be of a type to 
hold interest uniformly keen among the whole group of sub- 
jects — ^narration, and narration that is stimulating, with 
definite type of characters, and written by a writer conceded 
widely to be a master of style. The higher the degree of 
tmiformity in certain essentiai particulars, the more valuable 
is the matter for the present purpose. Uniformity of rhetor- 
ical style, strength of characterization, plot structure, descrip- 
tive power, and structural strength, are kept at a maximum 
by adherence to the works of the same writer. Then, again, 
uniformity of types of people presented in the stories is an 
aid to general uniformity of type of matter; also similarity 
of situation, geographical surroundings, the manner of living 
of people, and national setting. 
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With all these requirements in mind, the works chosen for 
this experiment were the noveb and stories of the Russian 
writer, Turgenieff." Inquiry revealed that the auditors as- 
signed for this experiment had read practically none of his 
writings. From the first tests it became manifest that the 
element of interest was adequately provided, judging by the 
attitudes of the listeners during the reading and by their 
comment afterwards. Some had to be specifically instructed 
not to read the author's works during the course of the 
experiment; they had asked permission to read some of his 
stories by themselves. 

Proper Names, The matter of Russian names was handled 
in the following manner. At the beginning of the meeting, 
as soon as the audiences had taken their places and the reader 
had taken the chair, the title of the story was placed on the 
blackboard before the audience, together with the names of 
the characters who participated in tiie story. This was done 
with a view to reducing to a minimum any confusion over 
names so unfamiliar to an American audience as are the names 
of the Russian people. In no way throughout the experiment 
was any attempt made to require subjects to remember these 
names; while every effort was exerted to make recognition 
of them easy. By putting the names upon the blackboard a 
visual perception was added to an auditory. Always in the 
reports these names were so presented by the experimenter 
that the auditor never had to recall the name in order to 
indicate which of the people of the story he was discussing 
or reporting on. How this was handled will appear in the 
transcript of forms of report presented above. 

Resumi K>f Previous Readings. After the names of the 
characters of the story had been written upon the blackboard, 
the reader announced, " I am now going to read you part 

of a story by TurgenieflF, entitled " When 

the story was to be used for the first time, nothing more 
than this was said. However, when part of the story had 
been read to a given group, the reader preceded the test with 
a brief resum^ of the story up to the point at which he pro- 
posed to begin. This was done to enable every subject to 
start out with as full an equipment as possible of the story 
up to that point, so that those of superior retentiveness would 
not start with an advantage over those who happened to have 
retained little from the reading preceding. In this way a 
source of error was eliminated. 

*The edition used is the translation by Isabel F. Hapgood, and 
published in 7 volumes by Charles Scribner & Sons, New York, 1915. 
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Discussion of Results 
The foregoing results will be discussed under the follow- 
ing two heads : 

I. The Function of Changes in the Use of the Four Attri- 
butes of Sound in Oral Reading. 

II. Individual Differences in the Responses of Auditors. 
Series I and Series II are alike in technique and material; 

Series II was added in the conviction that this t)rpe of ex- 
periment needs a large number of cases for validity of results. 

I. Functions of Variation in the Use of the Four 
Attributes of Sound in Oral Reading 

A. Function of Median Range of Variation 

a) Mode 1, i. e., Median Range of All Four Attributes, 
holds the median position in relative impressiveness of the 
modes of reading employed, in Series II and in the total sum- 
mary for both series. The same is practically the case for 
the 11 modes of Series J. 

B. Function of Extreme Range of Variation 

a) Extreme variation of Quality, in the only instance in 
which it was used, Series I, seems to rank high in impressive- 
ness. Extreme Range of Time (Mode 5) gives results that 
are inconclusive; while Extreme Range of Intensity (Mode 
7) is low enough to suggest that for this kind of situation 
it is not impressive. 

b) When extremes of all attributes are used, the impressive- 
ness ranks high; Mode 10 is the highest of all in the final 
summary, as well as in all other tables and graphs except 
one. (Graph 2.) 

c) The one notable exception to the superiority of Extreme 
Change over No Change is in the matter of Time, Modes/ 
4 and 5. Mode 4, No Change of Time, tends to rank higher 
than Mode 5, Extreme change of Time. But conclusions 
based on this condition must not overlook certain characteris- 
tics of the audience and of the stimulus. 

C. Function of No Change in Attributes 
a) The three lowest modes are all of the type that eliminates 
change of one or all attributes of sound. The least impressive 
of all modes is that which eliminates all change. Mode 11. 
D. Functions of Each Attribute Separately Considered 
a) Pitch. Mode 2 (Extreme change of Pitch) shows a 
higher rank than Mode 3 (No change of Pitch) in Series I 
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and in the total ; but not in Series 11. In Series I the difference 
is marked. 

b) Intensity, Departure from Median Intensity shows low 
impressiveness (Modes 6 and 7), in the final summary. 

c) Quality. Quality was isolated only in Series I ; yet the 
results of Series I suggest that the dropping out of changes 
in Quality makes a pronotmced difference in impressiveness; 
for the gap between Modes 8 and 9 is one of the longest in 
the whole body of graphs. 

d) Time. Departures from median range in time makes 
little, if any, loss of impressiveness. Both No Change of 
Time (Mode 4) and Extreme Change of Time (Mode 5) 
show high rankings in the final summary. 

II. Individual Differences in Auditors 

A. General Divergence 

a) Auditors vary in average total retentiveness between 
.15 and .87. 

b) One subject, No. 1, stands out as markedly superior in 
retentiveness to all the others. 

c) Four subjects, 11, 15, 21, 23, make a distinct class, which 
is low in retentiveness. The remaining auditors form a middle 
class of fairly distinct uniformity. 

B. Special Divergences 

a) The two auditors lowest in total reporting response are 
foreign-bom, one a Filipino, No. 21, and the other a Chinese, 
No. 23. These two auditors respond" to only a few modes. 
They agree so nearly on Mode 4 as to provoke the question 
whether this is not a mode commonly acceptable in Oriental 
speech. Uniformity of Time. Changes in Intensity seem to 
disconcert them (Table I, Modes 6 and 7), as also departures 
from Median change of Quality (Table I, Modes 8 and 9). 

b) Subject 11 is worthy of special note. He reports that 
he almost never reads stories. Yet the results of a check 
test, calling for an immediate report, shows that his low 
record arises not because he does not apprehend the import 
of what is read; for he retains well under immediate report. 
In Series II he shows almost a 100% increase in response, 
due probably to training during the process of the experiment. 

c) Subject 15 asserts that he lacks visual imagery. 
Whether so or not, he also shows learning in the process of 
the experiment. His earlier records are for the most part 
blanks ; toward the end of Series II his records are relatively 
full. 
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d) Subject 1 is an exceptional case. His reports indicate 
that he is set to apprehend under all circumstances and that 
he retains well what he apprehends. The latest trials of the 
experiment indicate that he had become adapted to all modes 
of reading, no matter how foreign to his previous experience. 

e) All women subjects — numbers 22, 24, 26, 27 — rank well 
up in the total average. 

f ) The chief divergences in ability to report are shown by 
the male subjects, ranging as they do from .15 to .82. 

Conclusions 

1. There is a presumption in favor of using an extreme 
degree of change in all four of the attributes of sound during 
speech, especially for the purpose of securing retentiveness 
over an extended time. 

2. The four attributes of sound differ in their effect upon 
the responses to oral reading. 

3. Individuals differ widely in their responses to a given 
combination of change activities. 

4. Auditors tend to become adjusted to unconventional 
modes of reading. 

Subsidiary conclusions are: 

a) In intellectual impression (such as this type is) regula- 
tion of Pitch changes is significant : a wide range is preferable 
to no change. 

b) An even rate is superior to a rate excessively broken. 

c) Interference with normal d^ree of change in Intensity 
reduces apprehension, retentiveness, or both. 

d) Elimination of changes in Quality (Timbre) is greatly 
inferior to a wide degree of change. 

General Conclusion as to Type of Experimentation, As to 
whether this method offers promise of valid results for further 
use, the following evidence is offered. (1) A judgment 
practically unanimous among students of oral expression is 
that changes in Pitch are always significant, that absence of 
all change is detrimental to intellectual impressiveness, and 
that the most effective reading is with an abundant, even 
extreme, range of change in all four elements of sound. This 
study brings results precisely in accord with these judgments. 
(2) Among authorities in elecution there seems to be no unified 
opinion as to the effect of changes in Time; and this study 
leaves that issue with results that are inconclusive, calling for 
refinement of method or more data. (3) Interference with 
changes in Intensity so as to affect accentuation, could be 



Digitized by 



Google 



EFFECTS OF MODES OF PUBLIC READING 185 

assumed empirically to be detrimental to impressiveness ; and 
the experiment reveals just such a result. (4) Changes in 
quality are commonly assumed to represent changes in emotion, 
mood, total attitude, and hence highly impressive. This study 
strongly confirms this judgment. 

Hence it is a justifiable conclusion that a method which 
brings results that conform with generally accepted judg- 
ments on matters of widespread experience, will prove useful 
in deciding ultimately such issues in this field on which opinion 
is not as yet in agreement. 
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VOCATIONAL SELECTION FOR SPECIALIZED 
TASKS 

A Study of Selective Tests for Hollerith-Machine 
Operatives 



By Lawkbnce Marcus, Colnmbia University 



A team of star baseball players can be ruined by the man- 
ager's failure to recognize their grooves. This is quite as 
true, even though less apparent to the eye, in industry where 
producing and selling teams are playing for efficiency. As 
an illustration of the possible evil effects of unwise selection 
let us choose the case of the Hollerith card-punchers employed 
in the auditing of money orders. 

This work is of a simple nature. The operative punches 
the keys of a machine not unlike a simplified typewriter, 
which perforates cards according to the numbers on the 
cancelled money orders. Rapid co-ordination of eye and 
finger is the main requirement of a good worker. The opera- 
tive will improve immensely with practice, and as the opera- 
tion becomes automatic, the individual's output will increase 
greatly. 

Let us compute the possible losses incurred by poorly 
selecting these operatives. Whether the workers are poorly 
selected by present methods or not will be discussed later. If 
20 operatives are to be selected from a group of 100 candi- 
dates, according to hit-or-miss selection 10 "good" workers 
and 10 "poor" ones will be chosen By "poor" worker is 
here meant one who would come into the lower 50 if the group 
of 100 candidates were arranged in an ascending order of 
merit. Of the 80 rejected candidates there are about 40 who 
are better than 10 of those selected. Now let us see what 
the result of such a random selection is. 

Assuming that a fair scale of pay for the work done by 
a " good " operative is $100 per month, the loss for the first 
two months on the average novice is $30. Because of the 
unfamiliarity of the work, the operative produces in the first 
month only 38 per cent of what she will produce when she 
has reached her practice level, and in the second month 52 
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per cent of her maximum. If the minimum entrance salary 
is $60 a month, and the output is 38 per cent of a hundred 
dollars worth, it is a simple problem in arithmetic to compute 
how much the organization loses on each new operative in 
the first two months of her service. 2X60— (38-|-52)=$30. 
This is a necessary evil which is made up by the " good " 
operative later, for the pay adjustments necessarily lag a month 
or two behind her increases in efficiency. But in the case 
of the operative who will not later make "good," this is a 
complete loss, and since the individual practice curve is a 
varying, uncertain thing, there is no way of predicting before 
the eighth or tenth month whether any one girl is going to 
make a good operative or not. 

This loss on the individual operative is not the only financial 
loss. The overhead of training, Supervision, floor space and 
furniture cannot be computed so exactly, but conservative 
estimates point to a total of $11,600 saved on every 100 opera- 
tives. By proper selection a force of 100 workers can be 
reduced by 12, with the following approximated savings 
itemized : 

Salaries (12 workers at $75 per month) annual. . $10,800 
Supervision (Part service of a $1,600 supervisor 

for 50 operatives) 400 

Space (At 50 square feet per worker, and space 

selling at 50c. a foot) 300 

General Overhead (Machines, light and heat, 

furniture, illness, etc.) 100 

Total Savings $11,600 

If we then note once more that the loss to the organization 
is $30 for each operative who does not make good, we can 
estimate in terms of money, just what random selection does 
for the careless employer. 

There is another factor which is not so easily measurable 
in terms of money, but has a money equivalent nevertheless. 
There is a certain feeling of contentment possessed by the 
worker satisfied with his job and interested in it. When a 
man gets into the wrong job, he labors under a strain, both 
mental and physical. He is dissatisfied, frets, cannot bring 
himself to do his best work, and is much more likely to resign 
than the contented man who knows he is in the position for 
which he is best fitted. The physical strain naturally results 
from racing to keep up the pace and do a task set too high. 
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This strain causes over-fatigue, and the errors and decreased 
output that result from fatigue. That a healthy, contented 
work-force is an asset has been indisputably proved by the 
experience of those commercial houses that have installed 
rest-rooms, medical care, recreation rooms, etc 

To summarize, then, a poor selective process chooses for 
costly training many candidates who wiU never make good 
workers, and from this it follows that: 

(1) Money is spent unnecessarily in the trial-and-error, 
hire-and-fire process; 

(2) More workers are employed than would be necessary 
with proper selection ; 

(3) The general tone of the working force is lowered, 
offering fruitful soil for dissatisfaction and movements of 
unrest. 

Various methods are used to-day by commercial organiza- 
tions in selecting their employees. That they are making 
progress, even though very slowly, cannot be denied. The 
attention of business men was attracted by various sincere 
writers and investigators to the value of careful and scientific 
selection of their personnel, chief among these being HoUing- 
worth, Gowin and Scott. But since business awoke to the 
need, there have risen a host of " guides," " scientific employ- 
ment managers," " personnel engineers " and other pretenders 
who cry that they are ready to meet the demand with " scien- 
tific methods" and "tests." For the most part these claim- 
ants, prepared overnight to act as Applied Psychologists, are 
insincere charlatans, parasite camp-followers of the scientific 
bearers of an Idea. These quacks have recently come into 
the field to profit financially by selling business men bogus 
selective methods. The well-meaning and receptive business 
man usually buys the "expert's" services without inquiring 
very deeply into his proven methods, without asking for an 
analysis of the quality of the goods. 

It appears that Applied Psycholc^ is going in for a period 
of exploitation which must inevitably be followed by a period 
of skepticism and suspicion on the part of the business world. 
This has happened in the case of Efficiency systems. Taylor 
and Barth and Gantt were able and sincere men, devoted to 
th« investigation of efficiency and best-method work, but these 
lions were followed by a drove of jackals and business was 
not able to discriminate. We now have the reaction. Con- 
ditions will doubtless be bettered, methods of judging the self- 
named " efficiency expert " will be found, and order will come 
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out of the chaos. So with " Vocational guides/' and " per- 
sonnel managers/' but only after the business man learns to 
discriminate. 

Besides the physiognomist, there are the phrenologist and 
the palmist. These are not so successful in selling their wares. 
The palmist is generally discredited by the business man, but 
although he no longer believes in life lines, he still listens 
respectfully to orations on the '' Significance of hand and 
fingers " by the physiognomist. The phrenologist capitalized 
his bumps for a time, but is fast losing the confidence of busi- 
ness executives. Proof is not forthcoming that a bump over 
the right ear is evidence of brains dedicated to salesmanship, 
and the phrenologist is bound the way of the clairvoyant and 
palmist. 

There is yet another vocational " specialist." He invents 
"tests." Sometimes he calls these "psychological tests/' but 
they are no more psychological than tests. Some of these 
tests are ingenious, others are quite simple, and their value 
lies in the confident statement of the inventor that they select 
the type of worker desired. If, for instance, a number of girls 
are to be chosen to operate certain machines, the candickites 
are placed before an innocent little board with holes in it. 
They are told to plug certain of these holes with matches. 
Upon their efficiency at this task is based the judgment as to 
whether or not they will be able to operate their particular 
machine skilfully. The assumption is as follows: motor co- 
ordination is required to run a machine; motor co-ordination 
is required to perform this match-hole test ; therefore efficiency 
in one is guarantee of efficiency (at least potential efficiency) 
in the other. It is a bright thought, and so simple, like all 
great revolutionizing thoughts. But the over-curious student 
asks impersonally whether it has been proven, mathematically 
or in any way other than the inventor's statement, that a 
valid correlation exists between machine-operating and hole- 
stuffing? It is hoped that a correlation does exist, because 
it is so distressing to see confident but unsupported state- 
ments go into the scientific discard. 

* Of course, the great majority of business men have not 
called vocational doctors; nor have they swallowed sugar- 
coated but futile pills. They know that all is not well with 
the world, but they declare Ihat they feel vocationally " so-so." 
The average business man advertises for a certain type of 
employee and reads in testimonials what his former employers 
have to say about his abilities. 
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The testimonial is a pectiliar document. Were one to call 
the average executive's attention to the fact that he is 
" strongly exaggerating " Jones' virtues and thickly slurring 
his vices, he would be very indignant The fact remains that 
Jones is not deserving of all the glorious garments that are 
draped on him. But the writer of the testimonial knows that 
a virtuous Jones must emerge if the testimonial is to be of 
any value, so he gets out his bright colors, sets himself squarely 
to admire Jones and daubs a few edifying adjectives. The 
words, unusual in ordinary business English, sound well and 
he grows bolder, adding finer and better sounding words and 
phrases, until he feels himself edified, sharing with Jones 
his glory. Thick and eloquent the phrases fall in his exulta- 
tion, and Jones appears — brilliant. 

The new employer knows the grand and glorious feeling 
of writing testimonials, so he discounts the exaggerations 
until an approximate Jones results. By his own letter and 
in an interview Jones tells what he has done in the past, and 
this is taken as prophecy of his future value. The larger 
corporations have application blanks in which the applicant 
tells about himself in a regulated way. Most of these blanks 
are designed to arrive at the candidate's experience briefly. 
Brevity seems desirable, so Jones is asked to state briefly 
on two short lines, just what he did for the past seven years. 
Some of the blanks ask questions which are intended to draw 
forth replies that form a picture of the candidate's character. 

One blank asks a candidate whether he has "ambition," 
" mental accuracy " and " patience," among a dozen other 
traits, and in a space about 2 inches by 1.2 inch he is asked 
to tell why he thinks he possesses each attribute. The ques- 
tion was respectfully put to an executive who put much store 
in this blank as to whether in his opinion a shrewd applicant 
could not answer in the affirmative to all the virtues and give 
plausible reasons for each. He wagged his head in satisfied 
fashion and said, " We find out what we want to know from 
this," implying that someone on the staff could analyze the 
replies, and by properly weighing exaggerations and " reading 
between the lines " could lay bare the applicant's soul and 
get his true measure. If this is to be considered true, it 
should be proven. 

Since neither the palmist, phrenologist, character-reader, 
" test "-specialist, nor vocational " guide " offers selective 
methods that stand up under analysis and requests for proof, 
what is the best way known thus far to select 10 girls for a 
specialized task from 30 that apply? 
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If, for example, a correlation is found between the ability 
to assemble a simple electric bell and the ability to repair 
motor cars, then the man who does well as a bell assembler 
will make a good auto mechanic If the ability to t)rpe write 
is found to correlate with the ability to cancel the letter A 
on a page of reading matter, then a girl who cancels A's rapidly 
and accurately will make a good typist. Why not, then, choose 
your typists from these candidates who cancel A's well? A 
sample of the actual work can be obtained so easily in the 
case of typists that the value of the indicator here lies rather 
in its use as a vocational guide than as a vocational selector. 

A typical procedure which illustrates the method and its 
possibilities is brought out in the following study of the tests 
used in the selection of Hollerith machine operatives. The 
present tests are analysed, certain empirical tests are applied 
and the results compared. The problem is to select from 
inexperienced female candidates those who will become rapid 
and accurate operatives of the Hollerith statistical machine. 
The Federal government requires the services of many of 
these operatives and they are chosen by means of the exam- 
inations of the Civil Service Commission. 

According to the Civil Service Law of 1883 : — 

** Such examinations shall be practical, in their character, 
and so far as may be shall relate to those matters which will 
fairly test the relative capacity and fitness of the persons 
examined to discharge the duties of the service into which 
they seek to be appointed." 

The Commission must, then, test the " relative capacity " of 
applicants for government service by means of an examination. 

Let us examine the Civil Service tests with this question 
in mind : "Are these true indications of the applicants' poten- 
tial efficiency on the job?" 

It appears that excepting for technical specialists, such as 
chemists, engineers, etc., these tests are all scholastic ones; 
that is, they test the scholastic ability of the applicant — they 
determine how much learning the applicant has acquired. 
Whether scholastic ability is an indication of clerical or sub- 
clerical ability is an important question and in the interest 
of the team should be based on something more substantial 
than an assumption. The following inferences are made with- 
out sufficient foundation: 

(1) That scholastic ability is a measure of native intelli- 
gence ; 
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(2) That intelligence is a prime factor in the personal 
efficiency of subclerical or specialized workers (whose task 
may require rapid recognition or continuous rapid motor co- 
ordination) ; 

(3) That this general native intelligence is equally an 
asset at all such tasks and that, for instance, an efficient money 
counter must also be a good press-feeder. 

These inferences, which are founded on assumption rather 
than facts, are frequently untrue, and in these frequent cases, 
square pegs are badly fitted into round holes with the result 
that the Service suflFers. 

In order to correlate e^ciency as card-puncher with ability 
to score high Km the Civii Service examination, we must first 
establish our orders of merit. Let us arrange those who 
have already been tried out on the job in an order of merit, 
the best worker being number 1 and the poorest worker 
being 115. 

Working in the Post Office are some 150 operatives whose 
output is recorded daily, both for quantity and accuracy. The 
total efficiency of any worker is the product of her speed times 
her accuracy, computed in the following way: 

Efficiency = Speed X Accuracy 

(1) A daily output of 3,200 is considered lOO^fc Speed. 

(2) Total absence of errors is considered 100% Accuracy. 

(3) For every error, 50 is deducted from the actual output 
of cards, with a proportionate drop in the speed rating. 

(4) The accuracy per cent rating is obtained by dividing 
the " revised speed rating " by the " actual speed rating." 

An example: 

Miss X punches 2800 cards with 4 errors. 
2800 

(S) Speeds = 87Ji% 

3200 

2800-4(50) 2600 

(A) Accuracy = = = 93% 

2800 2800 

(E) Efficiency = S x A = .875 x .93 = .814 

This worker's efficiency that day is 81.4%. 

This is not the whole story, however, for in order to get 
a valid " order of merit " in card-punching efficiency we must 
take into consideration the effect of practice. That is, we 
cannot compare Miss Jones who has been in service two 
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months with Miss Smith who has been in service for thirty- 
two months. In order to allow for practice, we plotted the 
practice curve, which we based on the records of twenty 
efficient curatives who had been in service for over two years 
and who apparently had passed their practice period. The 
procedure was as follows: 

With 3,200 as the daily average of cards punched, and with 
a penalty of 50 cards for each error, the final efficiency of 
20 "good" operatives was averaged and plotted. In the 
twenty-seventh month of service the 100 per cent mark is 
reached, i. e., either the operative punches 3,200 cards as a 
daily average without errors, or she punches so many more 
that her errors bring her down to a credit of 3,200. The 
units (per cents by months) are given here both as the monthly 
arithmetical average as corrected by "smoothing the curve." 

Practice Curve op 20 Hollerith Card-Punching Operatives 
Month Per Cent Efficient Month Per Cent Efficient 





Arithmetical 


Smoothed 




Arithmetical 


Smoothed 




Average 


Curve 




Average 


Curve 


1 


38.28 


38.3 


15 


94.25 


94.4 


2 


52.43 


51.9 


16 


95.72 


95.1 


3 


60.96 


61.4 


17 


95.33 


95.7 


4 


68.90 


68.3 


18 


96.39 


96.1 


5 


73.89 


74.2 


19 


96.83 


96.7 


6 


79.74 


79.3 


20 


95.45 


97.2 


7 


82.95 


83.4 


21 


97.14 


97.7 


8 


87.31 


86.3 


22 


98.81 


98.1 


9 


87.44 


88.4 


23 


98.38 


98.6 


10 


89.71 


90.0 


24 


98.62 


99.0 


11 


91.62 


91.1 


25 


97.86 


99.4 


12 


91.51 


92.0 


26 


97.33 


99.8 


13 


93.14 


92.7 


27 


98.52 


100.0 


14 


92.92 


93.5 









Consider an operative, Miss Y, who has been in service six 
months, whose record we have for the 73 days immediately 
preceding the eighth month allowing about 25 days for a 
working month. We compute the normal efficiency, that is, 
the average efficiency of the group, during the seventh, sixth, 
and fifth months (73 days' record) and compare with Miss 
Y's record. The normal efficiency is taken from the com- 
posite practice curve. The following proportion is true : The 
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normal perfected output is to the normal three months' out- 
put as Miss Y's perfected output will be to her three months' 
average output Then 

100 X 

78 80 

Where 78 equals the average of normal outputs for 3 months 
(5th, 6th, and 7th), and where 80 equals Miss Y's average 
three months' output and where x equals Miss Y's efficiency 
after she has passed her practice period. By thus bringing 
the inexperienced operatives up to their theoretical final 
efficiency, we can establish a fair "order of efficiency." 

The validity of this order of efficiency is discussed later 
when it is compared with 80 unrevised records, of 80 workers, 
each of whom had been employed for 20 months or more. 

In drawing a practice-curve the two peaks, unusual 
jumps in the 13th and 24th months, appear at first glance 
to be caused by some factor entering those months and not 
the others. Nothing can be discovered, however, for there 
can be no seasonal element involved, since any worker may 
reach her 13th month of service in any seasonal month, de- 
pending on the date of her entry into service, and these are 
varied. Were it the 12th and 24th or 13th and 25th months, in 
which peaks occurred, the theory of an annual salary increase 
might be entertained. The peaks are probably no more than 
might be expected with the individual girls varying so in their 
course of practice. The peaks are well within the possible 
deviations. An inspection of the individual practice curves 
shows at a glance the lack of uniformity in individual improve- 
ment. A sharp rise in one, a weak catenary in another, etc., 
causes us to accept the peaks as not so unusual. 

Having established our "order of efficiency," let us turn 
to our "Order of Civil Service Ratings." The examination 
as given by the Civil Service, takes about 2-3 hours, the 
candidates being assembled in one room and tested in the 
following subjects: Spelling 

Arithmetic 
Letter Writing 
Penmanship 
Copying. 
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The spelling test consists of 20 words, distinctly read and 
defined by the examiner. Arithmetic consists of simple prob- 
lems involving fractions, decimals, per cents, etc. Letter 
writing is a test of writing (composition) ability, and copying 
consists of transcribing from plain and " corrected " copy. 
Penmanship is judged, if we can say that it is judged, on the 
merits of all the written work. A photograph is attached to 
the application blank which is required of every candidate. 

When the examination papers are scored, certain weights 
are given the subjects. These weights are arbitrarily chosen, 
and apparently not very well chosen, for by trying various 
other weights a slightly higher correlation was found between 
the newly weighted totals and efficiency as a worker. See 
table later. 

Now, if a coefficient of correlation of .5 should exist be- 
tween CIVIL SERVICE grades and card punching EF- 
FICIENCY, we could say that ability in one is an indication 
of the individual's ability in the other. A good card puncher 
will pass a good civil service examination, and conversely a 
person attaining a high grade in the examination will be a 
good worker on the Hollerith machines. On the other hand, 
should the correlation coefficient be less than .4, it is probable 
that only a chance relationship exists, and a high grade in 
the civil service examination gives no indication of what the 
worker will do at the task. 

We found the Coefficient of Correlation between Efficiency 
and Civil Service =.31. The weights which the Civil Ser- 
vice Commission uses are: 

Subject Weight 

Spelling , 3 

Arithmetic 5 

Letter Writing 3 

Penmanship 3 

Copying 6 

20 



Four other ways of weighting were tried by rescoring each 
paper, and the TOTALS then correlated with EFFICIENCY. 
The results are tabulated on the following page : 
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Subject 


CmlService'8 
Own 


A 


B 


C 


D 


5;pAl1ir^ 


3 
5 
3 
3 
6 


4 
5 
3 

1 
2 


1 
3 
3 

2 




1 


Arithmetic 


1 


Letter Writing 
Copying 


1 

1 






CcMTelation 

Co-efficient (r) 


.314 


.311 


.273 


.343 


.345 


P.E.ofr. 


.06 


.06 


.06 


.06 


.06 



It will be observed that the best result is obtained by leaving 
the subjects unweighted and discarding penmanship entirely, 
and if no better tests are found, it is recommended that 
weighting system D be adopted for these subjects. This 
recommendation is based on the results obtained by the exam- 
iners with the present method of grading penmanship. At 
present over 9/10 of the grades are included in the range 
76%-80%, with 77^0 as the favorite mark. About >^ of the 
papers are scored 77%. This is not very discriminating. 

It is further recommended that, if the Commission seeks 
to measure the handwriting ability of the operative, some 
standard method of grading handwriting he adopted. A 
standard scale serves to overcome the examiner's individual 
idiosyncrasies and gives the judgment an objective basis. And 
the Commission's attention is invited to the Thomdike Hand- 
writing Scale. It has been in use for 10 years or more and 
is, therefore, comparatively new, and has probably not come 
to the Commission's attention, but in view of the results it 
has produced the Commission can safely venture to give this 
method a trial. A further suggestion as to the present exam- 
ination is that the number of test-words given in " spelling " 
be doubled. 

With these slight changes, i. e., handwriting and spelling, 
it is possible that the correlation coefficient may be brought 
up into the doubtful .4-.5 or even over .5 into the " certain- 
indication " level. 

Correlations were computed between EFFICIENCY and 
EACH SUBJECT, and the following coefficients found: 
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Conelation 
Subject with Efiidency P. E. 



Spelling r=.29 .06 

Arithmetic r= .30 .06 

Letter Writing... m .25 .06 in all these, 

Penmanship r= .14 .07 n=115 

Copying r== .21 .06 

Since the operation of the machine requires a certain nim- 
bleness of finger, and since the ages ranged from 19 to 54, it 
was thought that a negative correlation between AGE and 
EFFICIENCY might be found, but no correlation resulted, 
r being — .003. 

In search for a better indicator of card-punching ability, we 
examined the workers with 9 psychological tests, mainly of 
the Woodworth-Wells series. 

1. Cancellation (Cancelling "A"). 

2. Opposite (Given a word, to write its opposite). 

3. Whole-part (Given an object, to write some part of that 
object). 

4. Substitution (100 geometric forms, random distribution, 
to write in each form a number according to a code). 

5. Directions (The task being to obey complicated direc- 
tions). 

6. Number checking (To draw a line through every num- 
ber containing both a 5 and a 4). 

7. Completion (To fill in the words of mutilated sentences). 

8. VerlMjbject (Given a verb, to write its object). 

9. Logical Sequence (Given a paragraph with sentences 
disarranged, to put them in proper order). 

Each test was printed on a different sheet. 

The directions which were printed on the reverse of each 
sheet included examples of what would be found on the test 
paper. These directions were supplemented with verbal in- 
structions until each operative understood what she was to do. 
At a signal the sheet was turned over and work begun. 

Scoring 

In all of these the time was fixed as indicated, the score 

being the number of correct reactions. 

(1) Cancellation of A's. Time 60 seconds 

Credit 2 for each one right, 1 for each one half-right 
(questionable reaction) and penalize 3 for each wrongly 
marked. 
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(2) Opposites. Time 90 seconds 

Credit 2 for each one right, 1 for each one half -right 
(questionable reaction) and penalize 3 for each wrongly 
answered. 

(3) Whole— Part. Time 50 seconds 

Credit 2 for each one right, 1 for each one half-right 
(questionable reaction) and penalize 3 for each wrongly 
answered. 

(4) Substitution Time 110 seconds 

Add the number correctly done and penalize 2 for each 
wrongly marked. 

(5) Hard directions. Time 90 seconds 

Credit correct reactions and penalize 2 for each incor- 
rect reaction. 

(6) Number checking. Time 80 seconds 

Credit 2 for each one right and penalize 2 for each 
one skipped and 3 for each wrongly marked. 

(7) Completion. Time 360 seconds 

A credit of 10 was given each sentence correctly filled 
out and partial credit was given on the basis of the 
number of omissions and the number of blanks to be 
filled out. 

(8) Verb— Object. Time 50 seconds 

Credit 2 for each one right, I for each one half-right 
(questionable reaction) and penalize 3 for each one 
wrongly answered- 

(9) Logical sequence. Time 70 seconds 

6 sentences in exact order equals 100; 5 sentences in 
exact order equals 80 ; 4 sentences in exact order equals 
50; 3 sentences in exact order equals 20; less than 
3 sentences in exact order equals 0. 

The following introduction was given the experiment: 
^'We are going to perform an experiment in Applied Psy- 
chology. Doubtless you have heard of Prof. Miinsterberg 
and his psychological experiments in the movies. The pur- 
pose of his experiments was to test the power of observation. 
Just what character of the mind we are going to study, I am 
afraid I cannot reveal until the experiment has been com- 
pleted. To do so would vitiate the results. This experiment 
is being done with the direction of the Auditor, and it will 
te to your advantage to do your part as well as possible in 
these tests that are to follow. Some of these tests may ap- 
pear nonsensical, but may I remind you again that it is im- 
perative that you follow directions carefully." 

The tests were administered to 2 groups of about 75 in 
each g^oup, in a lai^e room with chair and desk provided 
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for each person. Both groups were examined between 10.30 
A. M. and noon, of a bright, sunny day, the temperature being 
73° C, and the test conditions being on the whole, fair. 

After scoring, correlations were computed between EF- 
FICIENCY and EACH TEST separately. Then TEAMS 
of 3, 5, and 6 tests were correlated with EFFICIENCY, the 
teams comprising those tests which had separately given high 
coefficients. The standing of any worker in the " Team of 
3 '* ranking is obtained by averaging her rank in each of 
the 3 tests included in the " Team of 3." 

The coefficients follow: 

r P. E. 

(1) Cancellation 019 .06 

(2) Opposites 154 .06 

(3) Whole-part 119 .06 

(4) Substitution 236 .06 

(5) Direction 046 .06 

(6) Number Checking 094 .06 

(7) Completion 211 .05 

(8) Verb-object 031 .06 

(9) Logical Scxiuence 316 .05 

Team of 3 Tests (4) (7) (9) .453 .05 
Team of 3 (Weighted: 

Te8t4by3lT. 

Test 7 by 27. 5 

Test9by41.2) 391 .05 

Team of 5 Tests (2) (3) (4) 
(7)(9) 448 .05 

Team of 6 (Weighted: 

Test (1) by 5/4 

Test (2) bv 4/3 

Test (3) by 1 

Test (4) by 2 

Test (7) by 7/4 

Test (9) by 8/3 '73 .05 

In order to check the method of allowing for practice as 
described some pages back, correlation coefficients were com- 
puted for EFFICIENCY and SEQUENCE of 80 cases hav- 
ing 27 months or more experience. These 80 had certainly 
reached their practice level, and when the coefficient thus olh- 
tained is compared with that obtained for 138 cases (some pro- 
rated for practice effect) these two coefficients are found to 
be nearly alike (r=.319 in one case and .316 in the other). 
This seems to uphold the scheme of proportions by which 
the individual operative's efficiency was adjusted for practice. 
Another similar check gave the same result, the " r's '* being 
.277 and .236 when 80 experienced (27 months) and 134 
mixed workers are correlated for SUBSTITUTION. 

Theoretically, the coefficient should be higher when 80 un- 
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adjusted cases are used, and this is borne out in the very 
slightly increased coefficients. The individual practice-ciu^es 
which go to make up the composite curve may rise far above 
or below the main curve for any month and false adjustments*' 
are not compensating. They must inevitably transpose indi- 
viduals in the order, with accompanying decrease in coefficient. 
In this case, however, few such transpositions have been made 
as witnessed by the check of the 80 unadjusted cases. 

Separate correlations were made for each test for group 
II, some 50 cases. No coefficients of significance were pro- 
duced, the P. E.'s being as large as the coefficients in half 
the tests. 

The danger of prophesying as to which test will be an 
indicator of any performance is brought out by the low co- 
efficients of Cancellation and Number-checking. From a 
superficial analysis of the task it would appear that a quick- 
ness of recognition and a nimbleness of finger were prime 
requisites. A sort of rapid complex reaction would be essen- 
tial. And it was believed that Cancellation and Number check- 
ing might be good tests. They are not, for neither an r of 
.019 nor of .094 can be said to be indicative. Had we pro- 
ceeded like the match-stuffing vocational specialist previously 
mentioned, we would have declared them valid tests without 
trial. 

A table of correlations and their probable errors follows : 

CORRELATION OF EFFICIENCY WITH TESTS 





CaaciB 


Both Groups 


Groups II 


^ 


r 


P. E. 


Group II 
50^6 
cases 


P.E. 


Cases 


(1) Cancellatkm 


137 
134 
133 
137 
138 
136 
138 


.019 
.154 
.119 
.236 
.048 
.094 
.211 
.031 
.316 

.448 
.453 


.059 
.056 
.056 
.055 
.058 
.057 
.054 
.058 
.051 

.045 
.045 


.120 
.021 
.210 
.081 
.103 
.386 
.085 
.118 
.219 


.091 
.092 
.087 
.092 
.091 
.079 
.092 
.091 
.087 


56 
50 


(3) Wide— part 

(4) Substitution 

(5) Directions 


50 
50 
49 


(6) Number Checldng. . . 

(7) Completion 


58 
50 


(8) Verb-Object 

(9) IxMical Sequence 

Tests: 
Team of 5 (134 cases) 

Tea«i>?3Wc2.!S) 
(7) (9) 


49 
50 
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Team of 3 (138 cases, weighted as described on page 199). 

r=.391 P. E.=.05 (Both groups) 
Team of 6 (138 cases, weighted as described on page 199). 

r=.373 P. E.=.05 (Both groups) 
80 cases having 27 months' experience or more: 
Efficiency and Sequence r=:.319 P. E.=.05 
Efficiency and Substitution r=.277 P. E.=.055. 
Since the " Team of 5 " Psychological tests correlates .45 
with EFFICIENCY at Hollerith (grating, and since the 
Civil Service Commission's examination correlates only .31, 
it is believed that the " Team of 5 " is a better selecting 
medium for the reasons that: 

(1) A coefficient of .45 is well into the "indicative" zone, 
while .31 is below even the hazy " zone of suspicion." 

(2) .45 is about 10 times its P. E., while .31 is about 5 times 
its P. E. In spite of the fact that 5 P. E. includes about 99% 
of a normal curve, it is felt that this is not a superfluous 
point. 

(3) Taking the coefficients on their numerical values, the 
Tests' coefficient is about 50% greater than the Commission's. 

(4) The " Team of 5 " can 1^ completed in 12 minutes and 
can be scored in 2, while the Civil Service test takes several 
hours to write and at least 10 minutes for careful examination. 

Conclusion 
It is by such procedure as has been followed here that 
selective media will be established. The work of sincere 
investigators is beginning to bear results. Already there are 
tests for the selection of Typists, Telephone-operators, Sten- 
ographers, Label-pasters, and a half-dozen others. The day 
of the quack is near. His eloquent but empty booming will 
be silenced by mathematically proven facts about vocational 
selection and guidance. 
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A CASE OF PHENOMENAL MEMORIZING BY A 
FEEBLE-MINDED NEGRO 



By Hiram Byrd, University of Mississippi 



Eugene Hoskins is his name. He lives at Oxford, Miss., 
a University place of about three thousand people. He is 
well known about town for his eccentricities, but more espe- 
cially for his uncanny knowledge of dates. A bystander said 
to him: "I was married on the 8th of June, 1901." With- 
out a moment's hesitation Eugene said : " Dat was Satu'day." 
Given the month, day and year, he will give the day of the 
week. He never fails, never hesitates. Vary it if you will 
by giving the year and month and asking what day of the 
month was the second Tuesday, or the fourth Friday — ^he 
answers just the same. It is one of the diversities among 
the university students to get old calendars and try him out. 
He is a never ending source of entertainment for them. 

I have said he never fails. That is, so long as you stay 
within his limits, for he has limits. Go beyond that and he 
is at sea. He can't go back beyond 1901, and can't go for- 
ward beyond 1924. But during these 24 years success is 100%. 
It should be noted, however, that his limits have not always 
been so advanced. Mr. Harvey remembers when he could 
not go beyond 1920, and Eugene himself admitted to me that 
he is advancing his limits and hopes to reach 1925 by next 
year. Asked how he does it, Eugene says he can't tell you — 
that he doesn't know himself. So the impression has gone 
forth that it is a sort of supernatural gift. 

Eugene says he was bom in Tate County, Miss., September 
10, 1896, which is probably correct— one can almost imagine 
that he remembers it. He is rather tall, regular build, and 
quite black — the tj^ that is known in the race as " eight-rock'** 

He has a habit of shrugging his — I started to say his 
shoulders, but I believe it is his whole back that he shrugs. 
It certainly gives that impression. He also has a habit of 
mumbling to himself, and often laughs right out. 

^A pure blood African is, among some of the Southern negroes, 
called " eight-rock," while half-breeds are known as '' ginger-breads 
and lighter shades as "high-yellows." 
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The first time he ever went through his paces for me he 
held out his hand for money. I gave him a dime which he 
accepted, but he will rarely accept more than a nickel. He 
has been known to refuse a dollar and become indignant when 
the donor put it in his pocket. He would not touch it and 
insisted that it be taken out. He is fond of music and keeps 
a guitar, but he can only thnrni. He used to beg one of the 
students in the University (Mr. Harvey) who plays a violin 
to play with him. I lately arranged with Mr. Harvey to 
do so, and proposed it to Gene, but he assured me he could not 
irfay, and would not engage to try. He stays with the Gam- 
bles, who furnish him food and clothes and a place to sleep, 
in return for which he delivers papers, gets in coal, feeds the 
pigs on the farm, and does little odds and ends about the place. 
He trusts the Gambles implicitly, but buys his own sugar for 
his coflFee. He is variously called Eugene, CJene, James and 
Jim. He resents being called Jim and will not answer to it. 
When the grass was burning and was about to reach the Rogers 
house, some one called out to " Jim " to bring a pail of water. 
But he balked and refused to move. When asked about it 
later he said : " Da wan't talkin' to me— I ain't Jim." But 
when Mr. Gamble calls him Jim it amuses him — he takes no 
exception to it. He meets all trains that pass in the daytime 
and in the early part of the night. It is said that he meets 
them all. I had occasion to leave recently on a train between 
three and four o'clock in the morning. He was there to meet 
that train, although it was a very chilly morning. I was talk- 
ing with him once at the Gambles, questioning him about 
himself and family, when the locomotive whistled. He darted 
out of the room almost Uke a released spring. I asked him 
yesterday if he meets all trains. He said not, and told me 
of two or three times that the trains had passed when he 
didn't meet them. (More light will be thrown on this curious 
passion for the trains later.) He has never been to school 
" to speak of " but keeps a pencil and a note book in which 
he prints out words. He spells out all the words he sees. In 
my office while taking the Binet test he stopped to spell out 
the word globe on a card index case. 

When he first came under my notice I resolved to analyze 
the case and determine definitely the source of this unusual 
power. I sought all the information I could get from those 
who had known him best and longest, and this I supplemented 



Digitized by 



Google 



204 BYRD 

with the Terman revision of the Binet test. It took several 
weeks making up to him to get dose enough to him to make 
the test. The Qunbles kindly helped me by telling him what 
a nice man I was and at the same time cautioned me not to 
call him "Jim." At length I struck his tender spot. After 
complimenting him on his unusual ability, I asked him why 
he didn't put it in the paper. Told him I would write it up 
for him if he wanted me to. " Den everybody see it," he said. 
But I didn't press the matter then. Only when I chanced to 
meet him I would manage to keep it before him. In the mean- 
time I had the stage all set waiting for the psydiologkal 
moment to test him. It came yesterday when I told him if 
we didn't do it during the holidays I couldn't take the time. 
He was then on his way to meet a train. Under suggestive 
pressure I piloted him up to the office and began the exam- 
ination. He liked it and opened up freely. 

There are several points of the examination that are worthy 
of note. The first is that his basal age is only four years. He 
failed at five to execute three commissions. From the basal 
age of four he " scattered " through to twelve, finally earning 
four additional years, making a mental age of eight. He did 
the most astonishing and contradictory things. For instance, 
although he has such a wonderful memory for dates, he failed 
utterly to repeat five digits in the seven year test. In the ball- 
and-field test he made a superior record, and in the Healy- 
Fernald puzzle succeeded in less than a half minute. But 
he could interpret a picture only in terms of enumeration^ 
could define in terms of use only, and thought that house 
rhymed with day. He read with some hesitation, but with fair 
understanding, but only got four out of the twenty-two memor- 
ies!!! His word test was interesting. He started oflF with 
names of places which I had to interdict, for as will be seen 
later, he has committed to memory a large array of these and 
could rattle them oflF a very long time before he would ulti- 
mately run down. So I suggested table as a starter, which he 
followed up with chair and university and then back to names 
of places. He was stopped again and started oflF with hat. 
From this he went to shoe, heel, shoe-shop, court-house, North 
Street, South Street, and here he stalled again. (The shoe- 
shop in Oxford is near the court-house, and North Street and 
South Street both lead directly from it.) He was encouraged 
and finally started oflF with the word peanut. He followed 
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this up with corn, wheat, rye, hogs, cows, calf, bull, cat, dog, 
rat, mouse, lice, picnic, churches, and here he made his final 
stand. It is easy to see why one brought up on a farm would 
pass from com, wheat, and rye to hogs, and on down to lice, 
but it would be interesting to know the historical setting that 
caused lice to suggest picnic to his mind. 

It is worthy of note that in the test evcrytfiing pertaining 
to ages and dates was perfect. Giving him full credit for 
this, his mental age would check up nine years. 

The next question is how to account for his remarkable 
ability to name dates. The following facts will throw some 
light upon it. He allowed me to keep his notebook above 
alluded to. Printed out on the first page is : " Mississippi 
Division, Jackson District." Then follows the names of sta- 
tions leading from Jackson, Tenn. — (Just as they were spelled 
out in his book) Bemis, Melases, Medon, Teag, Toone, Shandy, 
Bolivar, Hickery Valley, Temper, Grand Junction, Michigan 
City, Hudsonville, Holly Springs, etc He has two pages of 
these names, aggregating 34, which he took great delight in 
naming oflF to me. 

Then comes a page with the following words on it : " En- 
gine Number is 1746 Run from Frogmoor to Mounds. Engine 
Number is 795. 919 914 906 851 945 887 Run from Water 
Valley to Frogmoor 1 Miles to Jackson." Given a start on 
this page, he reels off everything on it. Then comes another 
page which starts : " Northern Line Passenger Engine Num- 
ber is 1140 1139 1008 1051 1108 1065 1080 1141. Run from 
Champaign to Centralia 130 Miles Illinois Division Cham- 
paign district." 

He can repeat this page if given three or four words at the 
start. Several other pages of like matter follow, all of which 
he can repeat when given a start. Only the last page he can't 
repeat — it is too new. He has not committed it to memory 
yet. All this explains his passion for meeting the trains. It 
also explains that his method is one of committing to memory. 
Now add to this the fact that he is gradually extending the 
time over which he can give dates, and his method is at once 
understood. He admits that he doesn't always write his dates 
down to commit them to memory. In like manner he can 
repeat a large number of counties, with their county sites, 
and a large number of states with their capitals, but without 
order, and no group is complete. The idea of completion 
seems not to have occurred to him. 
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Conclusions 

1. That his mental age is 8 to 9 years. 

2. That his auditory memory span is rather short, failing on 

5 digits. 

3. That he has by effort committed to memory a large array 

of facts along three lines: 

a. Dates 

b. Places 

c Locomotive engine numbers 

4. That he is continuing his studies along these lines, and it 

may be predicted that he will ultimately become even 
more proficient. 
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OPPORTUNITIES FOR COLLEGE GRADUATES IN 

PSYCHOLOGICAL EXAMINING IN SOCIAL 

SERVICE WORK AND EDUCATION^ 



By Mildred Frances Baxter, PsychoL Examiner, Dcpt. Education, 
Rochester, N. Y. 



The profession of psychological examining is still a com- 
paratively new one — ^very new when we consider how long 
those of teaching, nursing, law and medicine have been open 
to women. However, the field is extending rapidly. This 
is perhaps one of the benefits derived from the war, for in 
no other way could this science have touched and become a 
vital factor in the lives of millions, in so short a time. 

Because of the youth and rapid development of this pro- 
fession, the requirements for it have not been generally 
standardized. Nevertheless, the strong belief that stress must 
be laid on the absolute necessity for adequate training is held 
by all who are working in the field. The best way to bring 
this home to you, I think, is to quote from a few of those 
universally acknowledged as leaders in the work. 

Dr. Goddard of the Ohio State Bureau of Juvenile Re- 
search says, "The first requirement is a good foundation 
in practical psychology. A mere knowledge of terminology 
or book psychology is of little value, but one who has done 
experimental work, or any form of applied psychology is 
ready to begin. Just at present it is true that the demand is 
stronger for persons who have had sufficient experience to 
be able to go out and take charge, either of the examining 
in the schools or in an institution or some social organization. 
Yet the time is coming very rapidly when there will be open- 
ings for assistants in these positions and then much less 
training will be required. The great requirement, as always, 
is plenty of initiative, interest in the problem, and, of course, 
a good degree of natural ability." 

Dr. Healy of the Judge Baker Foundation in Boston 
writes, " I do insist that the proper attitude toward this work 

1 Read at the Vocational Conference, Vassar College, Feb. 21, 1920. 
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is to look at it from a truly professional standpoint and acquire 
a professional rating that will place the whole woric upon a 
dignified plain, where it should be. I think, then, the train- 
ing demands post graduate work and particularly the degree 
of Ph.D. Perhaps you already know of the association of 
Clinical Psychologists; a doctorate is necessary for member- 
ship in this. This association has already been recognized 
in the State Law of California. The demand has been so 
great that much less well equipped women have been given 
positions, but in the long run the situation will be the same 
as it has been in medicine. In fact there is no reason why 
the study of the human mind should not be worth as much 
as the study of the body." 

Dr. Elizabeth Woods who was formerly a member of the 
department of psycholc^ here at Vassar and is now Clinical 
Psychologist and Supervisor of Exceptional Qasses for the 
state of Wisconsin, says, " I feel very keenly that there is 
need for a longer training for this work than many people 
realize when their interest in it is first aroused. Already 
considerable damage has been done by 'six-weeks' psychia- 
trists,' as some of the physicians in the army called some of 
the examiners. It can certainly be stated without reserva- 
tion that clinical psychologists who have had the training which 
will qualify them for membership in the American Associa- 
tion of Clinical Psychologists are in demand and are getting 
salaries up to five and six thousand dollars a year." 

The demand for pre-professional training for this work is 
being met by an ever increasing number of the Universities, 
Normal Schools, institutions and organizations. Some of the 
Universities now giving courses helpful in this line are — Har- 
vard, Columbia, Carnegie Institute of Technolc^, Chicago, 
Leland Stanford, University of California, University of Michi- 
gan, University of Minnesota, Ohio State, Ohio University 
at Athens, University of Wisconsin and the University of 
Illinois. The course offered at Harvard during the summer 
is an excellent introduction to clinical work. Dr. Healy states 
"in Columbia, undoubtedly the best post graduate training 
is given." 

Work with Dr. Healy of the Judge Baker Foundation, of 
which the psychological clinic for the Boston Juvenile Court 
is a part, is allowed to count for a Ph.D. at Columbia. This 
Foundation controls two scholarships, as yet he does not 
know what will be the situation in regard to them for next 
year. One of these is in an industrial school settlement — 
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for the better adjustment of those attending the classes, 
through thorough examining, oversight and following up. 
The Ohio State Bureau of Juvenile Research, which I shsdl 
mention again later, is taking on a few research students. 
This is an excellent opportunity for those particularly inter- 
ested in juvenile delinquency. The Psychopathic Department 
of the Massachusetts State Hospital, in Boston, under Dr. 
G)rwell offers internships each year to one or two girls with 
a good background of psychology. Maintenance is given for 
half time service, the other half may be devoted to study or 
a paid position. This experience does not necessarily lead 
to a position, it is rather one step toward a Ph.D. Excep- 
tionally well prepared persons can occasionally get in with 
Dr. Adolph Meyer in the clinic in connection with Johns 
Hopkins University, especially if they are looking toward the 
study of medicine in connection with it. The Iowa Child Wel- 
fare Research Station under Dr. Bird Baldwin, established for 
the study of normal children, also takes on students. Dr. 
Woods suggests that many college girls will get an excellent 
start toward some sort of higher specialization by taking a 
summer school special teachers course and teaching in one 
or several types of the special classes such as have been organ- 
ized for genuine subnormals, adjustment classes for pedagogical 
retardates and for gifted children. Dr. Woods will be glad 
to have any who might consider teaching in special classes 
communicate with her about positions in Wisconsin.. The 
New York State Normal Schools at Oswego and Geneseo 
offer special training for the teaching of mental defectives. 

The qualifications and requirements for a clinical psy- 
chologist will become more and more rigid. Already New 
York state has passed a law that a psydhologist, to qualify 
for a certificate which will authorize him to examine for 
conmiitment to an institution, must have had at least two 
years graduate training and a certain amount of clinical ex- 
perience. My advice to you is to get in all the post graduate 
academic work you can as soon as possible. You will need 
it and will want it. Once you are in the swing of the work 
you will not wish to step out and get the further training 
you wish you had. 

The work of the psychological examiner as outlined in the 
report on the qualifications of psychological examiners, pre- 
pared by a committee of the American Psychological Asso- 
ciation is defined to include the following: (a) the measure- 
ment of general intelligence and specific native abilities; (b) 
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the measurement of educational attainment and vocational 
skill; (c) the collection of personal, social and psychological 
data regarding normal, defective, or gifted individuals; (d) 
the detection of the presence of the common varieties of 
abnormal mental conditions due to heredity, training or dis- 
ease ; (e) the giving of expert advice regarding the educational 
treatment of both normal and abnormal individuals. 

This work is carried on chiefly by Departments of Public 
Instruction, by courts, in institutions for delinquents and for 
defectives, in industrial establishments, and to some extent 
by Boards of Health and Social organizations. The field 
ranges from a national bureau through organizations and 
institutions in sections of the country, in states and in cities, 
to private societies. There is the National Research Council 
which is comprised of eminent psychologists who were organ- 
izers of the psychological work done in the army. This council 
is issuing two sets of group intelligence tests which will be 
ready in the fall, these have been their main work for the 
past year. They hope to put out new sets each year for a 
period of ten years. 

One piece of work that is covering the eastern section of 
the country is that carried on in the institutions for the blind 
under the direction of Professor Hayes of Mt. Holyoke Col- 
lege. Perkins Institute for the Blind, near Boston, is head- 
quarters for the work in the north ; the psychologist from this 
school goes to the schools in Hartford, Connecticut, — and in 
Batavia, New York. Overbrook in Philadelphia is the center 
for the more southern section ; the psychologist in charge here 
goes to the Virginia school and the Louisville, Kentucky one, 
her assistant to Baltimore and Pittsburgh. At present the 
assistant's salary is $450 and all living expenses, the other 
two are paid $500 and $600. Within the next two years 
or so the western schools are hoping to employ psychologists. 
It is probable that these positions will pay better rather soon. 

Several states have been alive for sometime to the problem 
of feeble-mindedness and are endeavoring to work out plans 
to meet it. The Massachusetts Society for Mental Hygiene 
has published a pamphlet containing a list of 39 out-patient 
clinics conducted in that state for the examination and treat- 
ment of patients with mental diseaise or defect. The cities and 
towns in the state which have psychological clinics are listed 
alphabetically with the name of the clinic, the location, the 
history, and information as to the special functions of each 
particular clinic. The state program, suggested by Dr. W. E. 
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Fernaldy requires that every institution and school for the 
feeble-minded should conduct out-patient clinics, at the insti- 
tution and in the various cities and towns served by the school ; 
and that a travelling psychologist should visit at least once a 
year all rural districts not otherwise reached. The New York 
State Commission for Mental Defectives, in a report to the 
governor and 1919 legislative assembly, proposed the state- 
wide establishment of clinics for the diagnosis and treatment 
of mental defect and disease. These clinics would co-operate 
with the health centers which the Department of Health is 
to establish throughout the state. Plans are now underway 
for the establishing of these by the commission. Emphasis 
is to be laid on mental defect as there are already clinics 
for mental disease. 

One thing that points to an immediate extension of the 
field for psychological examining is the request that comes 
from the state assemblies for surveys of their territories. 
Such a survey was conducted in Montana a short time ago. 
One has been going on in Indiana for some time with the 
immediate result that during 1919 a law was enacted pro- 
viding for a new institution in the southern part of the state. 
The Georgia CJeneral Assembly requested a survey which was 
conducted by Dr. Victor Anderson who, with an assistant, 
was sent as a scientific adviser by the National Committee 
for Mental Hygiene. In his report made in Oct. 1919 he rec- 
ommends, "the creation of clinics manned by the staffs of 
the State Hospital for Insane and the School for Feeble- 
Minded to act as a Clearing House for the defective, sub- 
normal, the peculiar and nervous children of the public schools, 
and the abnormal and delinquent children of the juvenile court 
and for various complex mental problems of the home and 
commimity." Other states have had these surveys and it is 
certain that still others will follow their example; it is likely 
that there may be a need for assistants in this work. 

Many states are building new schools for the feeble-minded 
and it is very probable that clinics will be established in most 
of these. Delaware is building one in Sussex County near 
Selbyville ; California one at Pomona and Massachusetts one 
at Belchertown. Tennessee has provided for the Tennessee 
Home and Training School for Feeble-Minded Persons; a 
provision in the law requires a mental examination within the 
first month of residence, a second within the first two years 
and a third within the first five years. The national school 
authorities having jurisdiction over federal districts and terri- 
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tories has added to their budget; if this sum was approved 
it would be used in part to found a School for Backward 
and Feeble-Minded Children in Mexico. A school is also 
being founded in the Hawaiian Territory. 

In the District of Columbia a House Resolution recently 
introduced in Congress has provided for a Division of the 
Bureau of Education for the study of the needs of mentally 
handicapped school children. There are to be three branches 
— first, for the investigation and publication of the test results 
and all information along this line; second, a laboratory of 
mental tests and standards of mental capacity for normal chil- 
dren of different ages, — ^these essentially for the diagnosis and 
classification of mentally subnormal and abnormal school chil- 
dren, and juvenile and adult delinquents; third, a psycho- 
educational clinic for the examination and classification of 
school children from the District of Columbia or elsewhere. 

Other states are leaders along educational lines. The Wis- 
consin State Department of Public Instruction has a State 
Clinical Psychologist and Supervisor of Exceptional Classes — 
whose duty it is — ^to diagnose problem cases in various cities 
throughout the state and to make recommendations for 
special classes. Besides being responsible for the personnel 
of these classes she must help in their organization and in 
the securing of a teacher for them, also so far as time permits 
she supervises the instruction. It is probable that this depart- 
ment will be enlarged in the near future. New York also 
has a state psychologist — Dr. Cornell holds this position with 
headquarters at Albany. 

In at least one state — Michigan — ^the State Board of Health 
employs — in their Psychopathic Department — 3. psychologist 
and an assistant who is called a field investigator. This state 
gives mental examinations to all venereal carriers apprehended 
and treated by the state; it is the duty of these two persons 
to examine the patients in the hospitals throughout the state 
and to aid in obtaining social histories. The salary offered 
the assistant was $1,200 and expenses. 

Again, the states are coming to appreciate the necessity of 
knowing the mental status of the children and adults brought 
before their courts and of the inmates of their reformatories 
and penitentiaries in order that they may handle the cases 
to the best advantage of the individual and the state. 

Ohio has been a pioneer state in what seems to be a most 
important phase of the work. Nearly two years ago Dr. 
H. H. Goddard who for many years has been director of the 
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research laboratory at the Vineland Training School for 
Feeble-Minded in New Jersey went to Ohio to l^gin the work 
of the State Bureau for Juvenile Research. Any judge in the 
state of Ohio may send any juvenile case to this bureau for 
an indefinite period of observation. After a most careful 
study of the case from every possible angle — medical, psycho- 
logical, social, educational, etc., the Bureau decides what ap- 
pears to be for the child's best — whether he should be sent 
to an institution, if so, which one,— or whether he should be 
retiuned to his own home or perhaps sent to some other 
better home. This report is given to the judge and he must 
act accordingly once the case has been turned over to this 
department. The work of the Bureau is not confined to court 
cases however though these must be attended to first. It is 
also a consultant and advisory body for parents who have 
children who are educational or social misfits for reasons 
other than inferior mental ability. 

Illinois is also contemplating a Bureau for Juvenile Re- 
search. 

The Iowa Child Welfare Station for the study of normal 
children has already been mentioned. 

As for the state penal institutions, clinics have alreadv been 
established in Sing Sing and Bedford Hills, New YorK, also 
in other states. California introduced a bill early last year 
for a department of psychiatry and sociology in the state peni- 
tentiary at San Quentin. Pennsylvania is considering the 
mental examination for classification of inmates of the prisons 
and reformatories. Mrs. Falconer, formerly at Sleighton 
Farm, the girls' reformatory for eastern Pennsylvania, realized 
the need long ago so that institution has had a resident psy- 
chologist for at least seven or eight years. The duties of the 
psychologist in this institution are to examine all who are 
committed to it, to report special examinations to the courts, 
to advise in matters of discipline, to aid in the classification 
of the girls in the dormitories and in their academic and voca- 
tional training within the institution and in the selection of 
those who should be given special school opportunities out- 
side the institution which may in some cases lead to a college 
education. The salary there has been maintenance and $50 
a month which is estimated as the equivalent of $1,200. Ex- 
perience of this kind is invaluable to anyone who aims at 
court work. 

Of New Jersey, Dr. Edgar A. Doll, Psychologist for the 
New Jersey State Department of Institutions and Agencies 
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writes, " the Department of Institutions and Agencies controls 
all the institutions supported by the state in whole or in part. 
This Department has definitely planned a Division of Medi- 
cine and Psychiatry. When this Division becomes fully func- 
tioning it will undoubtedly have a section for psychology. The 
purposes of this section will be to afford psychological service 
to the larger State institutions. The functions of the insti- 
tutional psychologist will be to make surveys of the mental 
capacities of the institutional inmates with a view to trans- 
ferring the inmates to the appropriate institution or to provide 
for their proper development or placement in the various insti- 
tutional activities. Undoubtedly, when this program is fully 
instituted, there will be positions in the State of New Jersey 
for psychological examiners in the form of social service work. 
At present this program is being partially carried out by 
means of a psychiatric clinic under the direction of the State 
Hospital at Trenton. The plans of the psychiatric clinic may 
later call for a woman psychologist in one of the correctional 
institutions. This position is not, however, as yet definitely 
created. When created it will probably pay about $1,800 and 
its duties will call for group and individual examinations 
leading to adequate psychological basis of classification and 
placement." 

We have considered the situation where the state is the 
unit ; in at least one instance a county is the unit. Erie Co., 
New York, has a psychological clinic conducted at Buffalo 
by the Children's Aid Society and the Society for the Pre- 
vention of Cruelty to Children. The children cared for at the 
Shelter, a temporary home, are given a thorough physical and 
mental examination. The psychologist's diagnosis and prog- 
nosis are considered a very important item in deciding the 
next step for the child's future, especially in cases which 
might be placed out for adoption. At present one experi- 
enced psychologist is employed by these organizations. 

When we come to consider cities as the field for work we 
meet the same types of problems to quite an extent. In edu- 
cation we find that the Boards of Public Instruction of all 
large cities have a Child Study Department or a Depart- 
ment of Research. The purpose of this branch is usually 
thought to be the weeding out of the subnormal children from 
the regular classes. In part, of course, it is ; they may receive 
a far more helpful and for them practical training in special, 
vocational or shop classes, and the brighter children will profit 
by the removal of the dull ones. On the other hand, there 
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are pupils at the other end of the scale who are so alert and 
capable mentally that they too present a problem for the school 
a(bninistrator in as much as the organization of the public 
school is such that it fits about 60-70% of the children. These 
departments may also aid in the organization of an entire 
school, for instance, Junior High Schools where large groups 
of pupils come from the sixth grades of several different 
Grammar Schools in different localities embracing children 
from various grades of American and foreign homes. By 
means of group intelligence tests which supplement the teach- 
ers' judgments these pupils are classified according to their 
general intelligence. 

The largest cities have for some years had clinics in con- 
nection with their courts, — especially with their juvenile courts. 
Chicago's is known as the Juvenile Psychopathic Institute and 
is under the direction of Dr. Herman Adler. Besides more 
experienced psychologists he has assistants who do routine 
examining but are not permitted to interpret the results. The 
Judge Baker Foundation under Dr. William Healy who began 
the Chicago work studies the problem of juvenile delinquency 
in Boston. Occasionally there is an opportunity for persons 
to receive an excellent training here. There has been a clinic 
for the Municipal Court in Boston under Dr. Victor Ander- 
son, he has left and whether it is still in operation I do not 
know. The Psychopathic Clinic of the City Children's Court 
of New York has two branches, the Manhattan Clinic and the 
Brooklyn Clinic, each employs one psychologist. Philadel- 
phia also has some provision for psychological examining for 
the courts. 

Probably a new endeavor in the field of public health ser- 
vice has been undertaken by the Newark, New Jersey, Depart- 
ment of Health. In 19Cfe it had established psychopathic 
wards in the City Hospital to care for mentally afflicted per- 
sons pending trial to abolish the practice of incarcerating them 
in cells. In 1907 a clinic for the treatment of nervous and 
mental diseases had been opened at the City Dispensary. Ex- 
perience from the work of these institutions showed that the 
Department of Health was the logical center for the co- 
ordination of all activities pertaining to mental health. Among 
the activities of the Bureau will be the care and treatment of 
mental disorders and maladjustments of behavior, the exam- 
ination of juvenile offenders referred by the Children's Court, 
the mental rehabilitation of discharged soldiers, the examining 
of mental cases from the Child Hygiene and Venereal Disease 
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Bureaus, the collection of statistics as to the niunber of feeble- 
minded, epileptics and delinquents in the community and the 
spreading of practical knowledge of preventive measures. In 
Newark also there is Dr. Maxfield's clinic in connection with 
the schools. It is possible that persons of relatively little ex- 
perience may find some opportunity for work with him. 

Private agencies and societies are coming to recognize the 
need for psychological advice, particularly those interested 
chiefly in children. In Boston the Children's Aid Society and 
the New England Home for Little Wanderers give routine 
tests; the Church Home Society in that city has adopted the 
practice of routine psychiatrical examinations for all children 
admitted to its care. They have a psychiatrist on their staff 
who examines, observes and treats the children. 

In New York City there are several clinics, the directors 
of these may have need of less experienced assistants. Dr. 
Schapp has a clinic, which was formerly known as the Clear- 
ing House for Mental Defectives, held at the Post Graduate 
Hospital. He makes examinations of all kinds of cases from 
babies to adults and wishes to know their mental age, where 
possible, before he examines them. On Saturday mornings 
he conducts a lecture and gives demonstrations for doctors. 
He employs one psychologist for part time work for which 
he pays $50 a month. Miss Irvin on 64th St. conducts ex- 
aminations for all children about to enter any grade in the 
64th St. school, and they are classified accordingly. This is 
not financed by the Public Schools. Volunteers who are 
familiar with tests may find opportunity for experience here. 
Miss Farrell has one in connection with the Special Classes 
of the city schools. Dr. Heckman also, has one at New York 
University, but it is not likely that he has any call for 
volunteers. 

Louisville, Kentucky, has a clinic which stresses the inti- 
mate relationship between organized social service and mental 
hygiene, under the joint control of the Board of Education and 
the Louisville Welfare League. Under the latter are fed- 
erated the social agencies of the city. These agencies refer 
cases in which mental trouble is suspected to the clinic The 
clinic is at the service of the juvenile and police courts; in 
the latter it is a matter of routine for this clinic to examine 
all infected women quarantined by the venereal clinic. Sur- 
veys are being made of institutions such as orphanages, and 
reformatories for the identification of mental defectives. It 
examines all admissions to the Kentucky Children's Home 
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Society. It assists in placing a check on the public school 
classes for superior children, " opportunity classes," classes for 
the retarded and the definitely defective. A mental survey 
of the Louisville schools is a project imder the direction of 
the clinic. 

The trend of the times in business and industry is to lay 
more stress upon the need for psychological selection of per- 
sonnel and psychological direction of welfare work. These 
positions are ordinarily paying from $150 to $200 a month. 
The duties of these positions will particularly call for knowl- 
edge of sociological relations, knowledge of educational meas- 
urements, knowledge of group psychological tests, knowledge 
of clinical psychological tests, ability to estimate vocational 
aptitudes and industrial capabilities, and particularly ability 
psycholc^cally to analyze personality make-up. Miss Rachel 
Pflaum, director of the Bureau of Occupations for Trained 
Women in Philadelphia, in an article in the New York Evening 
Post for February 5th states that, " more and more the large 
industries are coming to recognize the fact that women are 
better fitted than men for some of the executive positions. 
This was proved in the shops within six months after the 
United States got into the war; proved, that is, in the shops 
that had not learned it through experience." In many indus- 
tries women appear to be better fitted for the positions men- 
tioned above. In some concerns they are known as Employ- 
ment Managers, in others as Directors of Social Work. A 
few progressive concerns have also established research labora- 
tories for the purpose of working up tests to aid in the selec- 
tion of workers. The United States Rubber Co. in Hartford, 
Connecticut, has such a laboratory', also I believe, the Eastman 
Kodak Co. in Rochester, New York. The Black Co., in the 
clothing industry, in Cleveland, gives intelligence tests to its 
employees ; this and other companies in Cleveland promote, to 
a great extent, on a basis of these tests. 

The field of psychological examining is a most interesting 
one, it owes part of its fascination to its youth for we may 
hope to keep pace with it and to help it grow. The value of 
this work is being realized more universally all the time but 
still there is need of enlightenment on the part of the public 
and particularly on the part of the officials to whom we must 
turn for legal action. All is not plain sailing yet. Less than 
five months ago in a large middle-western city,'a feeble-mmded 
woman who had been a public nuisance for some time was 
brought before the court commissioner. An earnest appeal 
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was made by a member of a social agency to have this woman 
committed to an institution on the grotmds that because of 
her firmly established unsocial habits combined with her 
feeble-mindedness — she was a public nuisance. The official's 
reply was, " I should like to know what woman in the city 
of is not a public nuisance." The woman was not com- 
mitted. About the same time this official was induced to 
commit a young girl to the state institution for the feeble- 
minded. There was a delay in carrying out the order and 
a week later this same official, though it was contrary to the 
law, married this girl and permitted her to leave the state. 
However, we will hope that this is an extreme case and take 
comfort in Dr. Samuel McCord Crother's statement that, " You 
can't educate a grasshopper. He's too busy hopping. The 
peculiarity of man is that sometimes you can induce him to 
stop and think." 
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INTELLIGENCE AT SENESCENCE 



By M. F. Bebson, Ph. D., Colorado State Teachers College 



It is generally assumed that deterioration of the mental 
processes characteristic of senescence begins at about the age 
of 60 or 65. There is a utilitarian reason for knowing just 
what changes in the mental processes take place at senescence, 
and at about what age these changes make their appearance. 

In order to get some information on this subject, the writer 
spent five and a half days, from September 8 to 13, 1919, 
in testing twenty cases between the ages of 55 and 93 by the 
Stanford Revision of the Binet-Simon Scale. Ten of the 
subjects were men and ten were women. The average age 
of the group was 75 years. 

The tests were given to unselected inmates of a Home for 
the Aged. This institution is a private foundation, and is 
very strict with regard to the requirements for admission. 
It requires that the candidates for admission be worthy indi- 
viduals who have been good and industrious citizens. There 
is a long waiting list, so that careful selection among the 
applicants is possible. The inmates occupy splendidly equipped 
little cottages, either a married couple and one single man 
in a cottage, or four single persons in a cottage. The married 
couples keep house, and are supplied with all necessities upon 
requisition, and the unmarried ones take their meals at a 
central modem cafeteria. So the inmates of this Home are 
highly selected, and are not comparable with those of poor 
houses, county farms, or coimty, state, or municipal in- 
stitutions. 

On the other hand these inmates are probably not strictly 
comparable with old people of the same ages outside of the 
Homes. Their presence at the Home indicates that they have 
not generally been successful in life. Some, not laclang in 
mental capacity, are so deficient in certain traits of character 
and personality as to render them unable to compete success- 
fully with the usual business or professional or laboring man. 
A few are victims of drink or other forms of dissipation. 
Some others are, according to the testimony of the psychiatrist 
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in charge of the institution, lacking in sanity. One inmate 
is avowedly demented. A few suffer from paranoia. One 
spends much of his time sitting in the lobby of the most 
fashionable hotel in the city, smoking cigars with which the 
Home has provided him, writing letters on the hotel sta- 
tionery, and talking to the guests about famous friends and 
acquaintances. One of the most intelligent of thein has an 
uncontrollable propensity to beg, notwithstanding trials by 
the police court for the offense and frequent warnings and 
threats by the director of the institution. Another lives in 
filth, though placed in the most sanitary and healthful sur- 
roundings. Several of the old men show signs of abnormal 
sexual tendencies. 

The difficulties of testing old people were found to be far 
greater than those involved in testing children or college 
students. In the first place it was necessary to explain to 
each individual briefly the purpose of the test. Usually a 
brief explanation was given to the effect that the purpose 
of the test was to discover what the mental activity of old 
people is in comparison with that of young people. It was 
also necessary to add that it was not to be a test of education. 
The general plan was then to tell them that the test could 
be illustrated by an example, and if they did not object to that 
question, it would be continued. Then some interesting test 
would be given to begin with. From that point on curiosity 
would usually prevail over their caution, and the test would 
be continued with no great difficulty. Another means of 
arousing their interest was to ask them the questions for filling 
the blanks on the first page of the Stanford Record Booklet, 
questions concerning their family history and education. 

After the test was started, other difficulties were The desire 
of the subjects to wander away from the task and to talk 
about irrelevant matters, to ruminate, to give advice, or to 
discuss the questions. In most subjects the greatest difficulty 
of all was their garrulousness. With other subjects the diffi- 
culty was to keep them interested in the task. 

In one or two cases it was necessary to complete the test 
in two sittings. In one other case the subject, after taking 
one of two of the tests somewhat against his will, refused to 
go further with the task, giving headache as the reason for 
not desiring to continue the work. Two men could not be 
persuaded to take the test, but all the rest consented after 
a little persuasion. 

The average time required for the actual testing was one 
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hour and fifteen minutes. In twelve cases, owing to the 
lack of time or the great amount of irrelevant conversation 
by certain subjects, it was necessary to use the abbreviated 
scale or to give the complete scale only for the simpler ques- 
tions. Eight were tested with the complete scale. The average 
time required for testing these was one hour and thirty-two 
minutes, as compared with one hour and five minutes for the 
twelve tested by the abbreviated scale. All of the striking 
reactions were recorded, such as nervousness, lack of self- 
confidence, and attitude towards the test. The responses were 
recorded verbatim. Information was also secured concerning 
their professions, interests, manner of spending their time now, 
and other facts of general importance. Many of the subjects 
had visual defects. Following is a brief sketch of each case. 
The scores for the vocabulary tests are given in all cases 
where the subjects passed the average adult or superior adult 
vocabulary test 

1. (Complete scale.) Man, age 68; mental age (M. A.) 
8-6; I. Q. 53. About 8th grade. Swede. Carpenter. Came 
to America 1871. Speaks English well. In Home 2j4 years. 
Very lacking in self-confidence; hesitant and uncertain; very 
deferential. Realized his poor responses, and in spite of 
constant encouragement, often said, " No, that's very poor, 
but I could do better if I knew English better." Also made 
excuses because of "poor schooling." In the ball and field 
test said, " I don't understand that ; I don't know nothing about 
playing ball." One of the most neatly kept of all the cottages. 

2. (Abbreviated scale.) Woman, wife of the former, age 
55; M. A. 10-1; I. Q. 63. Dane. Went to school until 12 
years of age, then took a course in nursing in a hospital in 
Denmark. Remained in the hospital five years. One of the 
neatest housekeepers in the Home. Very lacking in self-con- 
fidence. Almost wept from embarrassment during the test. 
She put the examiner off twice when he came to test her, 
and attempted to do so a third time, but was always defer- 
ential and polite. Very apologetic. 

3. (Complete scale.) Man, age 82; M. A. 10-10; I. Q. 68. 
Education to about 8th grade. In Home 2 years. Carpenter 
and "contractor." Former captain in Civil War. Difficult 
to hold to task. Wanted to talk, to philosophize, to give 
advice. In the test of naming 60 words, could not name 
isolated words, but invariably made random sentences. Very 
self-confident. Garrulous. Said he would enjoy taking the 
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test every day. Is in love with one of the old ladies in the 
Home. 

4. (Abbreviated scale.) Man, age 73; M. A. 11-6; I. Q. 
72. Attended school until 15. Was then in " sixth reader." 
Favorite subject, history. Carpenter, cobbler, butcher, miner, 
etc. In Home 1 year and 3 months. Spends his time reading, 
tending lawn, and trimming trees. Has seven daughters and 
two sons, youngest 17, oldest about 36. Has been ill a good 
deal — catarrh, hay fever, hernia, rheumatism, sun stroke at 
age of 19. Nervous. Trouble with eyes. Mind wandered 
from task considerably. Interested in birds; studies a bird- 
guide. Talks constantly, especially about other inmates. An 
example of the loose answers given by many is his reply to 
the question, ** Why should we judge a person more by his 
actions than by his words ? " The response was, ** His out- 
ward appearance sometimes gives him away. Sometimes these 
confident fellows are dressed up well, and their actions would 
be fine. By George, they're just after the almighty dollar." 
In answer to the question, " What ought you to do before 
undertaking something very important?" the reply was, " Well, 
if that ain't another one. Very important — I'd be kinda 
dumbfounded on that." 

5. (Abbreviated scales.) Man, age 79; M. A. 11-6; I. Q. 
72. Education — sophomore in college. Occupation, mining. 
Bom in New York State; 54 years in the West. Three and 
a half years in the Home. SuflFers from asthma and leakage 
of the heart. Spends time reading daily papers and Literary 
Digest. Said by director of institution to be a case of paranoia, 
(joes to fashionable hotels, sits in the lobby, smokes and talks 
and writes letters on the hotel stationery. Speaks of his 
" famous friends," Rockefeller, et al. 

6. (Complete scale.) Man, age 84; M. A. 11-7; I. Q. 73. 
Bom in Bavaria. Finished German Volksschule. Speaks 
good English. Spends all his time painting portraits and 
scenes in oil. Witty, though humor is somewhat forced. Tries 
to be funny in all his responses, and attempts to conceal lack of 
ability by a pun or joke. In trying to repeat the 60 words, 
kept interrupting with the remark, "Ach Gott, ain't that so 
foolish. That's nothing to say; it's foolish." 

7. (Complete scale.) Woman, married, age 59; M. A. 
11-9; I. Q. 74. Bohemian; speaks English fluently. Attended 
school about five years. Former occupation — housework, 
nurse, cook in restaurant. Diseases — Syphilis — ^locomotor 
ataxia (walks with cruches; can hardly stand); cutaneous 
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aphasias, skin h3rpersensitive in spots; glandular affection, 
over-secretion of saliva. 

8. (Abbreviated scale.) Woman, age 81 ; M. A. 12-0; I. Q. 
75. Attended school only about a year. Says there are not 
many with whom she would exchai^e places. In Home 4)4 
years. Former profession — ^millinery. Had a stroke of 
apoplexy in 1893 which left her temporarily unconscious, blind 
and paralyzed. It affected her speech for six months. Vision 
now defective. Suffers some from neuralgia. Never read 
a book through in her life. Spends time now reading the 
Bible and newspapers. Absent minded. She asked three times 
to have the purpose of the test explained to her. Talks so 
incessantly it was difficult to keep her to the task at all. Con- 
sequently the testing was very slow. 

9. (Abbreviated scale.) Man, age 85; M. A. 12-2; I. Q. 76. 
Went to school until 15 years old. Blacksmith. In Home 4 
years. Reads a good deal, chiefly the Bible and religious 
papers. Does some gardening. Wants to get married. 

10. (Complete scale.) Woman, age 65; M. A. 13-2; I. Q. 
82.3. Vocabulary score 76. Completed 8th grade. In Home 
4 years. Profession nursing. Very disagreeable in the Home. 
Constantly quarreling with inmates, and making it unpleasant 
generally for the others in the same cottage. Abnormally 
neat and trim. Mania for spotlessness. Spends whole day 
cleaning the little cottage. Gets mad with rage and goes into 
hysterics if a towel is left out of place. 

11. (Abbreviated scale.) Woman, age 81 ; M. A. 13-4 ; I. Q. 
83. Vocabulary score 68. Attended a seminary two years 
after completing elementary school. Had great ambition to 
be a teacher. In Home 5 years. Totally blind from an im- 
successful operation for cataract. For this reason it was 
necessary to select from each group such tests as did not 
require vision. It was possible to choose four or five from 
each group which she could take. Sweet spirited. Very 
religious. Has different ones come in and read to her. Has 
a keen wit and sense of humor, and is youthful in spirit. 

12. (Abbreviated scale.) Man, age 76; M. A. 13-9.5; 
I. Q. 86.5. Vocabulary score 86. Attended school about five 
years, until 16 years old. Has had typhoid fever, rheumatism, 
hernia, and heart trouble. Somewhat deaf, and vision poor. 
Large tumor on back of neck. Very restless. Would get up 
and roam around during the test. Speaks with quick, nervous 
accent. Also very quidc in decision and response. Says he 
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remembers events that happened 50 or 60 years ago better 
than those of recent occurrence. Says he can tell where he 
spent every Qiristmas in his life. 

13. (Complete scale.) Woman, age 59; M. A. 14-2; I. Q. 
89. Vocabulary score 81. Attended school until 17 years 
of age. Went to about the 7th grade. Has had typhoid fever, 
influenza, pleurisy, and tuberculosis. Reads Scribners, Cen- 
tury, and Harpers Magazines, and some of Dicken's novels. 
Has a large vocabulary (score 81). Totally lacking in self- 
confidence; is perfectly dependent upon her mother, who is 
also in the Home. The superintendent of the institution says 
she depends upon her mother as a child. Her mother says 
that the daughter always asks her what dress to put on, etc 
Neurasthenic. Formerly suffered from hysteria. Very dirty 
in habits of life. Sometimes eats from garbage can. Curt, 
impudent, and unappreciative towards authorities. The mother 
(No. 19) recognizes her daughter's abnormality, and says she 
is mentally affected. The psychiatrist in charge of the insti- 
tution says she is abnormal. 

14. (Abbreviated scale.) Man, age 93; M. A. 14-8; I. Q. 
92. Vocabulary score 83. German; speaks English fluently. 
Education — 7th or 8th grade. Former school teacher. Reads 
current papers and writes poetry for pastime. Slips off from 
the Home and begs in town, though the Home amply 
provides for every need, including tobacco, and materials for 
ladies' fancy work. Has been in jail once for begging and 
threatened several times. When finally told that he would 
be put out of the Home if he persisted in begging, he said, 
" Well, I guess I'll have to quit that." Slightly deaf, eczema, 
digestive trouble. Abnormal sex tendencies. 

15. (Complete scale.) Man, age 87; M. A. 15-0; I. Q. 94. 
Vocabulary score 82. Went to about 7th grade in school. 
Ranchman. Good character. Sense of humor. An intelli- 
gent looking and intelligent acting man, cordial, hearty, and 
youthful in manner. Spoken well of by director. Took great 
interest in the test. 

16. (Abbreviated scale.) Man, age 76; M. A. 15-3.5; I. Q. 
95.5. Vocabulary score 74. Completed elementary school. Con- 
tractor. In Home 5 years and 3 months. Spends time garden- 
ing. Has a beautiful yard and extensive garden, and takes 
great pride in it. Very successful in raising all season straw- 
berries. Makes a good deal by selling these to tourists and 
visitors. Good natured, witty, and attractive personality. 
Likes to talk, and talks intelligently. Reads a great deal. 
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Is liked by inmates and authorities. Eyes defective, and some- 
what deaf. Had pleurisy at age of 23. 

17. (Complete scale for more difficult tests, but abbreviated 
scale for easier ones.) Woman, married, age 69 ; M. A. 15-11 ; 
I. Q. 99.4. Vocabulary score 88. Has suffered recently from 
a severe fall from which she was confined in bed 18 months ; 
also from rheumatism, a tumor operation, and nervous trouble. 
Formerly hired girl. Husband was a farmer and miner. In 
Home 4.5 years. Very religious. Garrulous. Reads religious 
papers and current magazines. Likes the National Geographic 
Magazine and the Literary Digest especially. Interested in 
the Bible and in history. Says she always had a vivid imagina- 
tion, and for that reason did not read novels. Reads to the 
blind lady, No. 11. 

18. (Complete scale.) Woman, age 80; M. A. 15-11 ; I. Q. 
99.4. Vocabulary score 80. Bom in Boston. Reached the 
third year of high school. Former nurse. Complains of the 
institution a good deal. Was put out of another institution 
for such complaints. Took great interest in the purpose and 
results of the tests. Continued asking questions about them 
nearly every day. Encouraged others to take the test. Feels 
her superiority in the Home. Is considered peculiar by the 
inmates. Enjoyed the examination, but laughed almost hyster- 
ically during most of the test. Is a Christian Scientist, and 
reads the literature a good deal. Suffers from growing 
cataract. 

19. (Abbreviated scale.) Woman, married. Mother of 
No. 13. Age 79; M. A. 16-3; I. Q. 102. Vocabulary score 
74. Attended school until 15 or 16 years old. Says she led 
her classes. Was married twice; husbands both farmers. 
Previous occupation, nurse, cook in restaurant ; ran a laundry. 
Occupies herself now with reading, sewing, knitting, and fancy 
work. Growing cataract. Bears tales to the authorities and 
to the town people. Keeps cottage in a very dirty, filthy con- 
dition. Treats her 59 year old daughter (No. 13) as a 
spoiled child. Was very apologetic for the daughter; ex- 
plained her condition and the " cause," and asked permission 
to observe her daughter take the test. 

20. (Complete scale for more difficult tests, but abbreviated 
scale for the easier ones.) Woman, age 68; M. A. 17-6; I. Q. 
109. Vocabulary score 80. In Home 4.5 years. Completed 
district school, and then attended a ladies' seminary from 
the ages of 15 to 18. Studied music as a child in Chicago, 
then in the ladies' seminary, then one year in the New Eng- 
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land Conservatory of Music in Boston, and under private 
teachers in Chicago when about 22 years old. Profession, 
music teacher for 22 years. Came to the West for her health 
35 years ago. Her health broke down several times while 
in the West. She had to support herself. " Life was a little 
too hard for my strength," she said. Now suffers from neu- 
ritis. Devotes her time to work on the place, and to sewing 
and china painting and mending. Was for a time very suc- 
cessful in china mending, by a process which she invented. 
Has a cottage and kiln in town, and still makes some money 
from that occupation. 

The average age of the group is- 75 years (74.95). Their 
average mental age is 13-3 (13-2.98), and their average I. Q. 
is 83 (82.92). The average age of the men alone is 80.3 
years. The average age of the women is 69.6 years. The 
average mental age of the men is 12-5.8. The average mental 
age of the women is 14 years and 1/10 month. The average 
I. Q. of the men is 78.21, as compared with 87.65 of the 
women. Thus the women have an average mental age of 
1 year and 6.3 months more than the men, and an I. Q. of 
9.44 points higher than the men, but the men are on an 
average 10.7 years older than the women. 

In order to ascertain whether this difference in favor of 
the women is due to the greater age of the men, or to sex 
differences, or to selective factors, several comparisons were 
made. It was impossible to get any information on the effect 
of age alone, regardless of sex, by comparing the five or six 
oldest in the group with the five or six yoimgest, because the 
five oldest were all men and the five youngest all women. 

Accordingly, in order to eliminate the age factor and get 
at the difference in sex alone, the five oldest women were 
compared with five men of approximately the same ages. 
The five men chosen were numbers 3, 4, 5, 12 and 16. The 
average age of the five men is 77.2 years; that of the five 
oldest women is 78 years. The average mental age of the 
men is 12-7 (12-6.96). The average mental age of the 
women is 14-8.16. The average I. Q. of the five men is 
78.8. The average I. Q. of the five oldest women is 91.8. 
So evidently the difference in intelligence between the women 
and the men is not due to the greater age of the men. As 
a check, the five oldest women were compared with the five 
youngest men. 

The average age of the five oldest women is 78 years; 
that of the five youngest men is 74.4. The average mental 
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age of the five oldest women is 14-8.16; that of the five 
youngest men is 12-1.4. The average I. Q. of the five oldest 
women is 91.8; that of the five youngest men is 75.8. The 
difference in the intelligence of the men and women is greater 
in this case than when those of equal ages were compared. 

Now the five oldest men may be compared with the five 
youngest men, and the five oldest women with the five youngest 
women in order to ascertain furthermore the influence of 
age on the mentality of these groups. The average age of the 
five oldest men is 86.2 years; that of the five youngest men 
is 74.4. The average mental age of the five oldest men is 
12-10.32. The average mental age of the five youngest men 
is 12-1.4. The average I. Q. of the five oldest men is 80.6; 
that of the five youngest men is 75.8. 

The average age of the five oldest women is 78 years ; that 
of the five youngest women is 61.2 years. The average 
mental age of the five oldest women is 14-8.16; that of the 
five youngest women is 13.4 (13-3.96). The average I. Q. 
of the five oldest women is 91.8; that of the five youngest 
women is 83.46. 

Finally the ten oldest of the entire group, without regard 
to sex, were compared with the ten youngest of the entire 
group. The average age of the ten oldest of the group is 
82.1 years. The average age of the ten youngest of the 
entire group is 67.8 years. The older group was composed of 
5 men and 5 women; the younger group also of 5 men and 
5 women, the five oldest in each case being men. The mental 
age of the ten oldest is 13-9.26; that of the ten youngest is 
12-8.7. The average I. Q. of the ten oldest is 86.21. The 
average I. Q. of the ten youngest is 79.63. The same fact 
is demonstrated again, notwithstanding the fact that the one 
who made the highest score (109) is only 68 years old, and 
has been in the younger groups throughout. 

Instead of the expected deterioration in the mentality of 
the older ones, due to senescence, it appears that for some 
reason the older ones are more intelligent than the younger 
ones. There is evidently some selective factor operative 
among inmates of such institutions which is stronger than 
the influence of age alone between the ages of 55 and 93. 
This fact appears constantly in all of the groups arranged 
for age comparisons: the ten oldest compared with the ten 
youngest, the five oldest women compared with the five young- 
est men, the five oldest men compared with the five youngest 
men, and the five oldest women compared with the five young- 



Digitized by 



Google 



228 BEESON 

est women. Only in a comparison of the five oldest men 
with the five youngest women is the advantage on the side 
of the younger group, and this is due to the much higher 
intelligence of the women than of the men tested. 

This greater intelligence of the older inmates of the msti- 
tution is probably due to the fact that the dull ones are 
unable to support themselves so long as the bright ones, and 
hence become dependent earlier. The more intelligent ones 
are probably able to earn a livelihood and provide and care 
for themselves longer, and consequently keep out of the 
Home longer, than the less intelligent ones. The more able 
ones finally come to the institution, no doubt, chiefly on account 
of old age (i. e. physical decrepitude), while the younger ones 
may come because of their inability, at a relatively young 
age, to make a living. It may be also that the more intelligent 
ones dread accepting charity more than the less intelligent, 
and consequently try more eagerly to avoid getting into a 
Home for the Aged, or to postpone it as long as possible, 
while the less intelligent probably care less, and consequently 
become a public burden at an earlier age. The fact that the 
older ones have survived sickness and death loiter may also 
be an indication of greater mental and physical vigor. 

Notwithstanding these facts, however, the women, though 
considerably younger than the men, are also much more 
intelligent. This might be a sex difference; it might be due 
to a slower deterioration of the mental processes of women 
than of men at senescence, but it is more likely due to the 
fact that women are paid less for their services and conse- 
quently find it more difficult to make a living than men, since 
relatively more is demanded of the woman worker for the 
same wages. There is probably ako less opportunity for old 
women to earn a living than for old men. Consequently, 
though relatively intelligent, they come to the Home early 
because of inability to support themselves. Most of the women 
(6 out of 10), too, are single women, and had to maintain 
themselves. Some are there because of illness, and others 
because of the early death of their husbands. In only one 
case was the husband still living with the woman. So some 
were likely suddenly thrown upon their own responsibility for 
the first time by the death of their husbands, and were unable, 
because of inexperience, to make a living. For these reasons, 
and because of the greater number of old women than old 
men existing, there are more women in such institutions than 
men. 

In order to determine the influence of education upon Ac 
ability of the inmates of this institution to earn a living and 
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to remain self-supporting until well advanced in years, com- 
parisons were made on the basis of school training and age. 
It was found that the ten older ones of the entire group 
attended school on an average about 7.9 years, and the ten 
younger ones 7.33 years. The men attended school 7.8 years 
and the women 7.33 years. The five older men attended 
school 7.8 years, and the five younger men also 7.8 years. 
The five older women attended school an average of 7.5 
years; the five younger women 7.2 years. Since the older 
group attended school as long as or longer than the younger 
group in all cases except where men and women are com- 
pared separately, this seems to indicate a greater love of 
school work by the older or more intelligent ones. The dif- 
ference in the school training of the two groups, however, 
is so small as not to warrant the inference that those who 
have attended school longer are more successful in life because 
of their slightly superior education. 

In order to ascertain what mental processes offer special 
difficulty to the old people, and which ones are easy, the 
following table is given, showing the number of subjects who 
passed each test correctly, and the number and percentage 
of those who failed on each test. In only two cases was it 
necessary to begin lower on the scale than age VIII. In 
group VII the 3rd test (repeating 5 digits) was passed by one 
woman and missed by one man. 



Tests 



1. 
2. 
3. 
4. 
5. 
6. 



1. 

2. 

3. 

4. 

5. 

6. 
Al. 
Al. 



Af:eVIII 

land fie 



TABLE I 

No.ofCases No.ofCases 
Answering Failing on 
Test Correctly Test 



Balland'field 2 

Counts 20-0 12 

Comprehaision, 3rd. degree 12 

Gives similarities (2 things) 12 

Defoiitions superior to use 6 

Vocabulary, 20 words 11 

Totals 55 

Age IX 

Date 12 

Arranging 5 weights 5 

Makes change 7 

Repeats 4 di6[its backwards 9 

Three words in sentence 11 

Rhymes 4 

1. Months 1 

2. Stamps 1 

Totals 50 



3 








2 
9 

6 
3 
3 





Percent 

Failing on 

Test 

60 






5.17 

14.28 
64.3 

0. 
40. 
21.43 
42.86 





iTi 
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TABLE I— Cont. 








NcofCaaes 


No. of Cases 


P^cent 




Teste 


Answenng 


FaHingoQ 


Failing on 




Test Correctly 
Ast X 


Test 


Test 


1. 


Vocabulary, 30 words 


18 





0. 


2. 


Absurdities 


16 


3 


15.8 


3. 

4. 


DeofDS 

Reading and report 



6 


10 
3 


100. 
33.33 


5. 


Comprehension, 4th. degree 


16 


2 


12.5 


6. 


Nammg 60 words 


2 


9 


81.8 


Al. 


1. Gdigite 

2. 20-^ syllables 


2 


1 


33.33 


Al. 


2 





0. 




Totals 
Age XII 

Vocabulary, 40 words 


62 


^ 


31.1 


1. 


16 


4 


20. 


2. 


Abstract words 


10 


2 


16.66 


3. 


Ball and field, superior plan 


4 


2 


33.33 


4. 


Dissected sentences 


7 


6 


46.15 


5. 


Fables, score 4 


11 


8 


42.1 


6. 


Repeating digite backwards 


7 


13 


65. 


7. 


Pictures, int^pretation 


13 


4 


23.5 


8. 


Gives similarities, 3 things 


16 


4 


20. 




Totals 


84 


43 


33.8 




Age XIV 








L 


Vocabulary, 50 words 


15 


3 


16.66 


2. 


Induction test 


1 


2 


66.66 


3. 


President and king 


14 


5 


26.31 


4. 


Problems of ^ct 


15 


4 


21. 


5. 


Arithmetiod reasoning 


7 


10 


59. 


6. 


Reversing hands of ckx:k 


2 


5 


71.43 


Al. 


Repeating 7 digite 





3 


100. 




Totals 


53 


32 


37.65 




Age XVI 








1. 




11 


8 


42.10 


2. 


Fables, score 8 


9 


10 


52.63 


3. 


Difference between abstract 










words 


4 


6 


60. 


4. 


Problem of enck)8ed boxes 


6 


11 


64.7 


5. 
6. 


6 dk:ite backwards 


3 



16 
3 


84.21 
100. 


Al. 


1. Repeating 28 syllables 
Totals 





5 
59 


100. 




63.52 




Age XVIII 








1. 




8 


4 


33.33 


2. 


Binet's paper cutting test 





6 


100. 


3. 


Repeating 8 digite 





12 


100. 


4. 


Repeating thought of passage 










heard 


3 


9 


75. 


5. 




1 


11 


91.66 


6. 


Ingenuity 





6 


100. 



Totals 



12 



48 



80. 
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Similar tables were prepared for the men alone and the 
women alone, but are not included here because they were 
fotmd not to yield results of great importance. Those facts 
which are significant are given in the following table. 

In table II are included all the tests which were missed 
by 50% or more of the entire group, or by 50% or more of 
the men alone or of the women alone. In only one case, 
No. 25, a test is included which was missed by less than half 
of the men alone or of the women alone or of the entire 
group, and this was listed because of the very great difference 
in the performance of the men and the women on this test. 
No other test not tabulated shows similar differences. 



TABLE II 

Showing the proportion of the entire group, the proportion of the 
men, and the proportion of the women who failed on each of the 25 tests 
which proved to be most difficult for the subjects. 

Ail Men Women 

Test 



Ratio Per cent Ratio Per cent Ratio Per cent 

1. Repeating 8 digits 12/12 100. 5/5 100. 7/7 100. 

2. Copying designs from 

memory 10/10 100. 5/5 100. 5/5 100. 

3. Ingenuity 6/6 100. 1/1 100. 5/5 100. 

4. Binet's paper cutting test 6/6 100. 1/1 100. 5/5 100. 

5. Repeatmg 28 syllables 5/5 100. 2/2 100. 3/3 100. 

6. Rating 7 digits 3/3 100 3/3 100. 

7. Code 3/3 100. 1/1 100. 2/2 100. 

8. Repeating 7 digits back- 

wards 11/12 91.5 5/5 100. 6/7 85.7 

9. Naming: 60 words 9/11 81.5 6/7 85.7 3/4 75. 

10. Repeating 6 digits back- 

ward 16/19 80. 9/9 100. 7/10 70. 

11. Repeating thought of pas- 

sa^heard 9/12 75. 5/5 100. 4/7 57.1 

12. Rev^Sighandsofadock 6/8 75. 3/3 100. 3/5 60. 

13. Inductkm test 2/3 66.66 1/2 50. 1/1 100. 

14. Repeating 5 digits back- 

ward 13/20 65. 8/10 80. 5/10 50. 

15. Problem of enck)eed boxes 11/17 64.7 6/7 85.7 5/10 50. 

16. Arranging 5 weighte 9/14 64.3 7/8 87.5 2/6 33.33 

17. Difference between ab- 

stract words 6/10 60. 3/5 60. 3/5 60. 

18. Ball and field, infenor 

plan 3/5 60. 2/4 50. 1/1 100. 

19. Anthmetical reasoning 10/17 58.8 6/9 66.6 4/8 50. 

20. Fables, score 8 10/19 52.63 6/9 66.6 4/10 40. 

21. Dissected sentences 6/13 46.2 4/7 57.1 2/6 33.33 

22. Rhymes 3/7 43. 2/3 66.6 1/4 25. 

23. Fables, score 4 8/19 42.1 5/10 50. 3/9 33.33 

24. Vocabulary, 65 wcxtls 8/19 42. 5/9 55.5 3/10 30. 

25. Three words in a sentence 3/14 21.4 3/7 43. 0/7 00. 
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From this it appears that the mental processes in which 
old people are most often deficient are, in the order named: 
immediate auditory memory for digits and for words, visual 
memory or perception, analysis and synthesis, inventiveness 
and ingenuity, motor co-ordination, imagination or percep- 
tion, using and manipulating numbers, arithmetical reason- 
ing, visual imagery, comprehension, logical memory, knowl- 
edge, abstracting common element — generalization and inter- 
pretation, quantitative comparison (kinaesthetic sensory dis- 
crimination), qualitative comparison, defining — ^association and 
analysis. 

Of all the more important functions, the old people are 
best by far in vocabulary. Eight out of the 20 subjects passed 
the superior adult vocabulary test of 75 words, all but one 
of these defining 80 words or more. The best two in the 
vocabulary test made scores of 88 and 86 respectively. These 
did not, however, make the highest scores on the whole scale. 
Their intelligence quotients were 99.4 and 86.5 respectively 
(case numbers 17 and 12). Three others passed the average 
adult vocabulary test of 65 words — intelligence quotients 102, 
95.5, and 83.3 (case numbers 19, 16, and 11), the latter a 
blind lady, age 81. 

In all of the 25 more difficult tests listed in Table II the 
women excel, with the exception of the induction test (men 
50% failures, women 100% failures), but this was given to 
only 2 men and 1 woman, and consequently the figures have 
little significance; and the ball and field test, inferior plan 
(men K)% failures, women 100% failures; 4 men and 1 
woman). 

The tests in which the women excelled very greatly were, 
in the order of the diflference in the results of the men and 
the women : 



Test 



1. Arrangement of 5 wekdbts 

2. 3 words in sentence (7 men 

and 7 women) 

3. Repeating thought of pas- 

sage heard 

4. Rhymes 

5. Reversing hands of ck>ck 

6. Problem of endoeed boxes 

7. Vocabulary, 65 words 

8. Disoected sentences 



Per cent Per cent 
Failures Failures 
by Men by Women 



87.5 
43. 



33.33 
00. 



Difference 



54.27 



43. 



100. 


57.1 


42.9 


66.66 


25. 


41.66 


100. 


60. 


40. 


85.7 


50. 


35.7 


55.5 


30. 


25.5 


57.1 


33.33 


23.77 
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Conclusions 

1. The Homes for the Aged are selective agencies. Some 
of the most important factors of selection operative among 
the inmates are probably: improvidence, indolence, lack of 
foresight, ambition, energy, and persistence, lack of force and 
strength of character; ill health or misfortune, bad habits and, 
among those very low in intelligence, their dullness or lack 
of capacity. Also whether or not they have children or rela- 
tives who can supoprt them, is doubtless an external factor, 
independent of traits of character or intelligence. 

2. The old people who are cared for by even the most 
selected Homes for the Aged are dull, average I. Q. in this 
one about 83. It is very probable that their dullness is due, 
to a great extent, to a decline in the mental processes at 
senescence. 

3. It is not possible by studies of the inmates of institu- 
tions or Homes of this kind to draw conclusions with regard 
to the average intelligence of the aged or the decline of the 
mental processes at senescence. 

4. The women in this Home average about 11 years younger 
than the men. 

5. The women in such institutions are, for some reason, 
considerably above the men in intelligence. This may be 
due partly to a slower deterioration of the mental processes 
of women in old age. It is very probably due in part to the 
fact that women receive less pay for the same quality of 
work than men, and consequently require greater intelligence 
than men in order to earn the income necessary for self- 
support. 

6. The older half of the entire group, as well as the older 
half of the men alone and of the women alone, are more 
intelligent than the younger ones. This is likely due to the 
fact that the more intelligent ones can probably remain self- 
supporting longer than the less intelligent ones, and for that 
reason come to the institution later than these. Probably 
also they endeavor more to avoid accepting public charity. 
They are also more highly selected mentally and physically. 

7. The younger, or less intelligent half of the women, are 
more intelligent than the older, or more intelligent half of 
the men. 

8. The men have, on an average, somewhat more school 
training than the women. The older half have generally had 
more school training than the younger half. This would indi- 
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cate that the more intelligent ones probably enjoyed school 
work more. 

9. No deterioration in mentality with advancing age could 
be found, because of selective factors, chief of which is prob- 
ably the one mentioned under caption 6. 

10. The mental deficiency is greatest in immediate audi- 
tory memory for digits and for words, and in immediate visual 
memory or perception, analysis and synthesis, inventiveness 
and ingenuity, imagination, manipulation of numbers, and 
arithmetical reasoning. 

11. The women were superior to the men in all the more 
difficult tests except two: the induction test, and the ball and 
field test (inferior plan). 
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RACIAL DIFFERENCES IN MENTAL FATIGUE^ 



By Thos. R. Garth, University of Tcxa« 

During the year of 1913-14 I made a study of mental fatigue 
during the continuous exercise of a single function which 
was tifie addition of columns of one-place numbers upon 711 
children of the schools of several school systems of the State 
of Virginia. About half of these were from the Tl-ird and 
Fourth Grades and the others were from the Seventh and 
Eighth Grades. From these I derived group curves. The 
description of the experiment and the interpretation of the 
results are to be fotmd in No. 41 of the Archives of 
Psychology, Columbia University, 1918. 

Later I thought it might be worth my while to give the same 
tests to negro children of the same grades and likewise to 
Indians. The negroes were tested in the spring of 1917 in 
the Baker School of Richmond, Virginia. In the spring of 
1919 I had the opportunity to give the same tests, by the 
courtesy of Mr. O. S. Lipps, Supervisor of the United States 
Indian School at Chilocco, Oklahoma, to two similar groups 
of Indians. 

The experiment consisted of adding the Thomdike Addi- 
tion sheets continuously over twenty-eight minutes of time for 
the younger groups and forty-two minutes for the older ones. 
I should say that the only break in the continuity was the time 
taken in going from one sheet to the next one and this break 
was not more than half a minute in duration. The subjects were 
allowed two minutes to a sheet. The motivation consisted in 
the experimenter's saying at the beginning of the performance 
that he wished to find out the best " adder " in the class. 

The Indians. 

In the Indian groups there were boys and girls of thirty- 
four diflFerent tribes whose degree of blood ranged from }i 
Indian to full blood. The Cherokees numbered 39; Creeks, 
21; Cheyennes, 14; Choctaws, 12; Chickasaws, 12; and Cad- 
dos, 13. In tfie various other tribes the numbers are too 
small to be given here. As to degree of Indian blood there 
were 91 full bloods, 8 of % degree, 28 of J4 degree, 4 of 
9/16, 47 half breeds, 10 of J4, and 1 of }i. It will be seen 
that nearly half of the Indians were full bloods. One hun- 

^Read before the Southern Society for Philosophy and Psychology 
at die New Orleans meeting, April 23, 1920. 

235 



Digitized by 



Google 



236 GARTH 

dred twenty-seven were ^ Indians and more. These figures, 
I understand are taken by the United States government and 
I believe are fairly reliable. 

The Negroes, 

No attempt was made to ascertain the purity of racial blood 
of the negroes. There were many mulattoes among them, but 
I believe that the difference in fatigue shown here is signifi- 
cant as pointing to racial difference in continuous performance 
of a mental act. 

In the Third and Fourth grade groups there were 368 whites, 
92 Indians, and 99 negroes. The average age of the whites 
was 9.9 years, Indians 14.8 years and negroes 11.5 years. 

In the Seventh and Eighth Grades there were 343 whites, 
98 Indians, and 34 negroes. 

The average ages of the above racial groups are: whites, 
14.05 years; Indians, 17.9 years, and negroes 14.3 years. 

We should also state that there were five Indians of the 
younger group in the fifth grade and that all the negroes are 
from the seventh grade in the older negro group. It was 
impossible to obtain enough Indians at the Chilocco school 
to make even hundreds in both groups. However, we do not 
believe that these discrepancies affect the results to any ap- 
preciable degree. 

Since the total performances of the racial groups are a 
matter of interest they are given herewith, though they are 
not presented as a part of the essential data from which to 
draw conclusion at present because the purpose of the experi- 
ment was to study not total performance, either attempted 
or accurate, but the fatigue of the groups comparatively. The 
total performance was — 

For Third and Fourth Grade Groups 

Attempts Accurates 

Whites Ave. 46.6 columns Whites Ave. 26.6 coltmms 

Indians " 49.5 " Indians " 27.0 

N^roes " 51.6 " Negroes " 32.2 

For Seventh and Eighth Grade Groups. 
Attempts Accurates 

Whites Ave. 123.60 columns Whites Ave. 84.80 cdumna 
Indians " 116.35 " Indians " 68.20 

N^roes " 117.82 " Negroes " 84.38 

Average of the Individual Curves, 

In the dissertation referred to above the writer states on 
page 9 : " The object in a study of this kind is to give every 
individual, whether his work is slow or fast, the same influ- 
ence upon the final average. It is not fair to the poor or 
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weak individual to put his small effort on a basis of absolute 
terms along with the effort of the better workers similarly 
expressed. The original data (absolute measures) — fail to 
represent truly the facts which we wish to bring out because, 
as intimated above, the rapid workers with their larger meas- 
ures of performance entirely swamp the changes that may 
occur in the work of the slower ones. But if everyone's work 
for the successive periods is reduced to percentages of his 
total, the slow count the same as do the fast workers in deter- 
mining the general work curve. For this reason we have 
derived percentage curves which represent more truly — (than 
the absolute measure curves) the central tendency of the 
whole group with regard to fatigue." 

For the reason given above it was thotjght best to reduce 
the performance of each subject at each two minutes of his 
working to a percentage of his total performance. This curve 
we have called the Individual Curve. An average of these 
individual curves was obtained for both, attempts and accur- 
ates, for each group. Only the Averages of the Individual 
Curves are shown here. This seems right to us since we are 
not just now studying the absolute performance of the groups 
but the fatigue of the racial groups. 

We give here Tables I, II, III, and IV, which show the data 
for the original unsmoothed curves. 

TABLE I 

Data for the Curves Representing the Average op the Individual 
Curves— Third and Fourth Grains 
Columns attempted in each period of two minutes, expressed as a per 
cent, of the total number attempted. 

368 Whites 92 Indians 99 Negroes 



Fenod 


Ave. 
PerC 


A.D. 


RET 


Ave. 
PCrC 


A.D. 


P.E. 


Ave. 
PerC 


A. D. P 


\E, 


1 


6.97 


1.94 


.09 


7.49 


1.38 


.11 


7.69 


2.60 


25 


2 


7.24 


1.52 


.06 


6.93 


1.27 


.10 


7.59 


1.50 


13 


3 


7.30 


1.37 


.06 


7.06 


.62 


.06 


7.67 


1.34 


11 


4 


7.24 


1.40 


.06 


7.07 


1.26 


.11 


7.82 


1.35 


12 


5 


6.97 


1.32 


.06 


6.70 


.78 


.07 


6.99 


1.30 


11 


6 


7.20 


1.32 


.06 


7.41 


1.07 


.09 


7.27 


.05 


09 


7 


6.97 


1.35 


.06 


6.61 


1.62 


.14 


6.34 


1.24 


11 


8 


7.29 


1.43 


.06 


7.07 


1.38 


.09 


6.66 


1.32 


12 


9 


7.34 


1.39 


.06 


6.48 


1.27 


.10 


6.65 


1.36 


12 


10 


7.28 


1.44 


.06 


7.52 


1.68 


.14 


7.03 


1.23 


11 


11 


7.27 


1.34 


.06 


7.66 


2.65 


.18 


8.18 


2.22 


19 


12 


6.78 


1.47 


.07 


7.22 


1.48 


.12 


6.93 


1.23 


11 


13 


7.25 


1.31 


.05 


7.55 


2.76 


.31 


6.72 


1.49 


12 


14 


6.90 
100.00 


1.62 


.07 


7.22 
100.00 


1.87 


.16 


6.46 
100.00 


1.19 


11 



Digitized by 



Google 



238 



GARTH 



TABLE II 

Data for the Curves Representing the Average op the Individual 
Curves— Third and Fourth Grades 
Columns accurate for each period of two minutes, in per cent, of total 
cdumns accurate. 

368 Whites 92 Indians 99 Negroes 



P^iriod 


Ave. 
PfcrC. 


A.D. 


P.E. 


Ave. 
PerC. 


A.D. 


P.E. 


Ave. 
Pd-C. 


A.D. 


P.E. 


1 


6.13 


4.53 


.20 


7.65 


3.54 


.32 


8.80 


3.38 


.27 


2 


8.34 


4.87 


.22 


6.17 


3.00 


.27 


7.93 


3.47 


.28 


3 


8.16 


4.34 


.21 


7.95 


3.42 


.28 


8.93 


3.52 


.29 


4 


7.53 


4.13 


.13 


3.42 


4.65 


.40 


7.70 


3.04 


.27 


5 


7.27 


4.20 


.19 


8.23 


5.14 


.45 


6.62 


3.48 


.28 


6 


7.76 


4.10 


.18 


7.26 


2.73 


.22 


6.97 


3.12 


.27 


7 


6.94 


4.01 


.18 


5.80 


4.58 


.40 


6.95 


2.97 


.25 


8 


7.24 


4.05 


.18 


7.54 


3.12 


.27 


6.98 


3.20 


.28 


9 


7.62 


4.57 


.21 


5.51 


3.92 


.30 


6.57 


2.78 


.20 


10 


7.16 


4.31 


.19 


7.92 


4.17 


.36 


6.67 


3.30 


.29 


11 


7.06 


4.27 


.19 


7.87 


4.12 


.36 


7.19 


4.32 


.38 


12 


6.10 


4.07 


.18 


6.93 


3.81 


.31 


6.87 


3.12 


.27 


13 


6.89 


4.30 


.19 


7.24 


3.34 


.29 


6.27 


3.03 


.27 


14 


5.80 
100.00 


3.75 


.17 


6.15 
100.00 


4.63 


.41 


5.55 
100.00 


3.40 


.29 



TABLE III 
Data for the Curves Representing the Average op the Individual 
Curves— Seventh and Eighth Grades 
Columns attempted for each period of two minutes in per cent, of total 
columns attempted. 

343 Whites 98 Indians 34 Negroes 



Period 


Ave. 
PerC. 


A.D. 


P.E. 


Ave. 
PerC. 


AD. 


P.E. 


Ave. 
PerC. 


A.D. 


P.E. 


1 


5.00 


1.01 


.05 


5.10 


.68 


.06 


5.91 


1.32 


.17 


2 


4.86 


.79 


.04 


4.68 


.39 


.03 


4.52 


.87 


.13 


3 


4.67 


.77 


.04 


4.61 


.62 


.05 


4.69 


.88 


.12 


4 


4.79 


.69 


.03 


5.12 


.81 


.07 


4.68 


.86 


.12 


5 


4.37 


.75 


.03 


4.64 


.64 


.06 


4 45 


1.00 


.15 


6 


4.73 


.72 


.03 


4.61 


.67 


.07 


4.12 


.34 


.06 


7 


5.30 


1.04 


.05 


4.50 


.71 


.06 


4.79 


1.81 


.27 


8 


4.63 


.79 


.04 


4.97 


.38 


.04 


4.75 


.71 


.10 


9 


4.51 


.75 


.03 


4.61 


.53 


.05 


4.97 


.74 


.11 


10 


4.86 


.75 


.03 


4.71 


.51 


.05 


4.79 


.58 


.07 


11 


4.80 


.68 


.03 


4.67 


.62 


.05 


4.84 


.80 


.12 


12 


4.43 


.74 


.03 


4.67 


.58 


.06 


4.69 


.74 


.10 


13 


4.42 


.88 


.04 


4.94 


.46 


.04 


4.54 


.44 


.06 


14 


4.68 


.83 


.04 


4.50 


.69 


.07 


4.80 


.92 


.13 


15 


5.58 


1.11 


.05 


4.81 


.68 


.07 


4.54 


.94 


.13 


16 


4.74 


.62 


.03 


4.72 


.66 


.07 


4.32 


1.33 


.21 


17 


4.80 


.71 


.03 


4.77 


.83 


.08 


5.28 


1.06 


.15 


18 


4.75 


.90 


.04 


5.05 


.42 


.04 


4.91 


.32 


.06 


19 


4.40 


.86 


.04 


4.90 


.59 


.05 


4.54 


1.06 


.15 


20 


4.84 


.91 


.04 


4.90 


.57 


.05 


5 24 


.51 


.08 


21 


4.76 
100.00 


.90 


.04 


4.84 
100.00 


1.06 


.09 


4.63 
100.00 


1.18 


.16 
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Data for the Curves Representing the Average op the Ira>iviDUAL 
Corves— Seventh and Eiqith CHudbs 

Cdumns accurate for each period of two minutes, in per cent, of total 
oohmms accurate. 





343 Whites 




98 Indians 


34 Negroes 


Period 


Ave. 
PerC 


A.D. 


P.E. 


Ave. 
Pd-C. 


A.D. 


P.E. 


Ave. 
PfcrC. 


A.D. 


P.E. 


1 


5.00 


1.74 


.08 


4.93 


1.90 


.17 


7.41 


3.04 


.45 


2 


4.85 


1.51 


.07 


4.19 


1.05 


.09 


4.57 


1.25 


.15 


3 


4.85 


1.51 


.06 


5.41 


1.38 


.11 


5.36 


2.00 


.30 


4 


5.01 


1.37 


.06 


5.65 


1.79 


.15 


4.05 


.70 


.10 


5 


4.50 


1.37 


.06 


5.20 


1.94 


.17 


4.67 


2.67 


.30 


6 


5.03 


1.33 


.07 


5.13 


1.74 


.14 


4.28 


1.10 


.15 


7 


4.70 


1.46 


.06 


4.39 


1.68 


.13 


4.43 


2.35 


.31 


8 


4.83 


1.37 


.06 


5.16 


1.82 


.16 


5.39 


1.61 


.18 


9 


4.73 


1.30 


.06 


4.03 


1.78 


.15 


5.97 


2.76 


.32 


10 


5.15 


1.48 


.07 


5.48 


1.76 


.14 


4.36 


.29 


.05 


11 


5.10 


1.28 


.07 


4.58 


1.89 


.16 


4.25 


1.42 


.21 


12 


4.34 


1.45 


.06 


4.39 


1.93 


.17 


4.67 


1.94 


.28 


13 


5.03 


1.39 


.07 


5.07 


2.63 


.22 


4.39 


1.48 


.22 


14 


4.37 


1.51 


.07 


4.05 


1.39 


.11 


4.28 


1.14 


.15 


15 


4.90 


1.48 


.07 


4.29 


1.48 


.12 


4.94 


2.18 


.30 


16 


4.74 


1.55 


.06 


3.51 


1.58 


.13 


5.10 


1.80 


.18 


17 


4.84 


1.42 


.06 


5.32 


1.09 


.09 


5.28 


1.18 


.16 


18 


4.73 


1.23 


.07 


5.02 


2.00 


.18 


4.28 


.87 


.12 


19 


4.40 


1.35 


.08 


4.89 


1.53 


.13 


4.05 


2.28 


.31 


20 


4.60 


1.53 


.07 


4.72 


1.60 


.14 


4.22 


2.10 


.30 


21 


4.30 


1.69 


.06 


4.59 


1.93 


.17 


4.05 


1.92 


.29 



The Original Curves 

The curves which we show here are not the original curves 
showing the Average of the Individual Curves but are the 
smoothed-out curves obtained by averaging the per cents for 
every two periods taken in succession. In the curves we find 
these features: 

Third and Fourth Gradesi — Attempts Curves. 

The whites show a warming up, fluctuations, reach their 
maximum in the ninth period or by the 18th minute; the 
Indians instead of exhibiting warming up show initial spurt, 
a falling away and recovery in the 10th period reaching their 
maximum in the 13th period ; the negroes like the Indians take 
an initial spurt and maintain a fairly good rate until the 6th 
period when they fall away, recover and then fall away 
again experiencing their maximum at the 11th period. 

Third and Fourth Grades — ^Accurates Curves 
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Fig. 1. — Showing averages of the individnal curves. 
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Fig. 2. — Showing average of the individual curves. 
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Here again the whites show wanning up reaching their 
maximuni in the 2nd period and after fluctuations fall away at 
the end; the Indians show as before initial spurt with maxi- 
mum at the 5th period and after fluctuations fall away at 
end; the negroes show initial spurt, maximum at 3rd period 
and with fluctuations fall away at end. 

Seventh and Eighth Grades — ^Attempts Curves. 

The whites here show initial spurt reaching their maximum 
in the 15th period and falling away slightly at the end; the 
Indians show initial spurt, maximum at 4th period, fluctuate 
some and fall away slightly, then recover toward the end of 
the practice; the negroes ^diibit a more decided initial spurt 
than was shown by the other races, the maximum occurs in 
the first period, fluctuations occur, a slight falling away is 
seen from which recovery is made at the last period but one 
which is followed by a falling off. 

Seventh and Eighth Grades — Accurate Curves. 

The whites again show initial spurt, experience their maxi- 
mum at 10th period fluctuate and fall away at the end; the 
Indians likewise show initial spurt, reach maximum at 4th 
period, after fluctuations fall away slightly at end; negroes, 
as in attempts category, exhibit initial spurt and maximum 
in the first period, fluctuate and experience decided fatigue 
at end. 

We are unable to give a satisfactory reason why the whites 
should reach their maximum first, then the negroes and after 
them the Indians in both attempts and accurates in the lower 
grades, and why the order for the upper grades should be 
for maxima, negroes, Indians and then whites. If an early 
occurring maximum indicates early fatigue, then the whites 
showed evidence of fatigue first and the negroes next in the 
younger groups. Should this be true the whites must have 
recovered much for they were able to resist the onset of 
fatigue better at the close than the negroes as will be shown 
later. As for the upper grades the order is not what we 
would expect as the Indians reach their maximum before 
the whites. Recovery on the part of the Red group might 
he the explanation. 
Fatigue, 

Since fatigue is indicated by a falling away from previous 
performance we have taken here the performance in the first 
three minutes as the standard and compared that with same 
number of minutes at the end. 
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Fig. 3. — Showing average of the individual curves. 



SO n 



»Inllaii8*~ - -Mesroes i 
Aoexurat« Perfomanc* 




^^trioas z 4 6 6 10 12 14 16 18 20 £1 

Fig. 4. — Showing average of the individual curves. 

These numbers show that for the younger groups 



In the Attempts 

Indians gained 3.25% 
Whites tost 3.00% 
Negroes lost 12.10% 



In the Accurates 

Indians lost 8.4% 
Whites lost 17.0% 
Negroes lost 27.2% 



In both categories, attempts and accurates, when we 
arranged the races in the order of least to greatest fatigue 
we have Indians, whites, and negroes. 



For the dder groups the numbers are, 

Accurates: 

Indians lost 1.30% 
Whites lost 10.20% 
Negroes lost 30.30% 



Attempts: 
Indians gained 2.10% 
Whites lost 4.00% 
Negroes lost 4.70% 
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While the evidence is not so clear as respects whites and 
blacks in the matter of attempted performance because the 
latter are only .7% worse than the former, the order seems 
to be the same as in the younger group, i. e., Indians, whites 
and negroes in accurates, and the Indians excel both races 
in resisting fatigue in attempted performance. 

The Age of the Indian Subjects. 

In giving the experiment and while working up the material 
the superior age of the Indians seemed to me to make it 
unfair to place them in comparison with the whites and 
negroes. There are two ways in which to meet this difficulty — 
(1) ascertain the eflfect of age on tendency to fatigue, (2) 
take the subjects white and red, age for age, and compare 
them to see if the age group of one race fatigued more than 
the same age group of the other race. 

As respects (1) the pertinent question is, What effect does 
age have on resistance to fatigue in the Indian group? To 
answer this a correlation between the age and the resistance 
to fatigue for that age-group was obtained. In the Third 
and Fourth Grades, the correlation for attempts is a negative 
one of — .26, for accurates it is +-03. For the Seventh and 
Eighth Grades the correlation for attempts is a negative one 
of — .20, for accurates it is — .31. These correlations are 
either all negative or so small that they are of very slight 
significance and could be ignored. 

In order to make the comparison suggested by number (2) 
it would be necessary to have larger groups of Indians than 
we could obtain for the age group comparison. However, we 
give a few coimparisons. 

In the lower grades 10 whites and 8 Indians of 13 years 
show an age-group loss of 35% for the former and a gain of 
8% for the latter in attempts, for accurates it is respectively 
loss of 37% and loss of 5%. 10 whites and 12 Indians of 
14 years show an age-group gain of 10% for the former and 
14% for the latter in attempts. In accurates it is for this 
age for the races respectively loss of 22% and gain of 1%. 

In the upper grades Attempts and Accurates 85, 77, 42 
and 4 whites and 7, 18, 13 and 25 Indians belonging to the 
age-groups of 14, 15, 16 and 17 years respectively showed 
these group changes for attempts — 

14 yrs. Whites sain of 1% Indians gain of 7% 

15 yrs. Whites loss of 3% Indians gain of 8% 

16 yrs. Whites loss of 4% Indians loss of 9% 

17 yrs. Whites loss of 9% Indians gain of 5% 
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These changes are shown for accurates: 

14 yrs. Whites loss of 7% Indians gain of 6' 

15 yrs. Whites loss of 11% Indians gain of 2% 

16 yrs. Whites loss of 22% Indians hen of 21% 

17 yrs. Whites loss of 12% Indians loss of 4% 

In the above comparisons the results are favorable to the 
Indians excepting in the case of the 16 year group in the 
attempts category where the whites lost 4% and the Indians 
9%, and in the accurates category where the advantage of the 
Indians over the whites is too slight to be noticed particu- 
larly, the numbers are 22% and 21% respectively. 

The conclusion to be drawn from this experiment, then, 
is that in a test to ascertain the difference between whites, 
Indians and negroes of equal educational opportunity in the 
matter of mentol fatigue so-called, the Indians of both the 
young and old groups tend to excel the whites and negroes 
in this respect both in the curve representing fatigue in 
attempts and accurates performance, likewise the whites excel 
the negroes in both these categories. 

The above conclusion is bas^ on the averages of the groups 
as tendencies. It is very likely that there is some overlapping 
to be fotmd in the fatigue data. Since this has not yet been 
measured we hesitate to say that we have here racial differ- 
ences. The probability is that they are not to be found in 
these data even as they are not revealed in many other in- 
vestigations. However, it is interesting to note that these 
Indians rate high on a scale of resistance to fatigue and that 
the negroes rate low, while the whites occupy a sort of middle 
ground if the average alone may be taken as an index. 
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A NEW APPLICATION OF PSYCHOLOGY TO 
INDUSTRY 



By Hbnry C Link, Ph. D. 



The following experiment, conducted in a sporting goods 
factory where the use of psychological tests for employment 
purposes has been extensively developed, indicates an entirely 
new way in which tests can be applied. 

An inspection shop, where some 80 girls were employed as 
bullet inspectors, was having difficulty with the current piece- 
work rate of pay. The foreman of the shop claimed that the 
rate was too low and that he was finding it impossible to retain 
his inspectors because of their dissatisfaction with their earn- 
ings. However, the time-study group whose business it was 
to set piece-work rates, asserted that the rate was a just one. 
Moreover, they showed that it was the highest rate which had 
ever been paid for that kind of work. An investigation proved 
that both claims were apparently well founded, and yet the 
investigation contributed nothing in the way of an intelligent 
solution of the problem. 

For the benefit of those who do not understand the piece- 
work rate or how it is set it will be necessary to give a brief 
description. The piece-work rate is a rate of remuneration 
which is governed by the quantity of work an individtial per- 
forms. It is a rate which enables each worker to profit di- 
rectly according to his capability. This rate, however, must 
first of all be determined, and this process requires a special 
study of the work to be done and of the comparative capabili- 
ties of those selected to do it. The men who make this study 
and who then set the rate are usually called time-study men 
from the fact that their study consists largely of timing, by 
means of a stop watch, the elements of the work or operation 
for which the rate is to be set. 

For example, in setting the rate for bullet inspectors, a 
time-study man first analyzes the operation into its elements, 
perhaps as follows: 

1. Picking up a handful of bullets. 

2. Inspecting bullet points. 

3. Reversing bullets and inspecting bases. 

4. Rolling bullets out of left hand into right and inspect- 

ing lateral surface. 

245 
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This constitutes a complete '* cycle " in the operation of bullet 
inspecting. By means of a stop watch, the time-study man 
proceeds to time each element of this cycle, timing as many 
cycles as he may think necessary. He may time the work of 
an inspector for one or two hours or even half a day, de- 
pending on the difficulty or importance of the rate to be set. 
In this way he obtains both the total time it takes the inspector 
to perform a certain amount of work, and also the various 
times required by each element in the operation. He then 
repeats his observations on the work of several more inspect- 
ors. On the basis of the results which he obtains from dieBe 
time studies, the time-study man computes what he r^;ards a 
fair average rate of production, or the amount of work which 
a girl of average ability may fairly be expected to do. On this 
basis, after certain allowances of time for fatigue, personal 
necessities, and other possible interruptions have been made, 
the rate is set. 

Rate setting by means of a time study is, therefore, in one 
sense, a psychological experiment, for it attempts to make an 
accurate record of a series of well-defined reaction times, and 
on this basis to compute the time for a series of typicaA reac- 
tions. However, it can readily be seen from the above descrip- 
tion of the time-study process that the rate resulting from such 
a study depends almost entirely upon the subjects selected for 
observation. If the subjects selected are representative of the 
group to which they belong, the study is likely to have a valu- 
able result. If the subjects selected are not representative — 
and this is frequently the case — the resulting rate will be too 
high or too low. For instance, a piece rate for fifty or more 
workers is often based upon a study of only two or three 
subjects. No sound statistical procedure is applied to control 
the great possibilities of error which may here arise. More- 
over, there is an equal lack of statistical soundness in the 
method by which the subjects who serve as the basis of the 
time-study are chosen. It is quite customary for the time- 
study man to go to the foreman and ask him to pick out two 
or three representative prls, one fast worker, a slow worker, 
and an average worker. The foreman, who most frequently 
has his own axe to grind, naturally picks out those workers 
who will be most likely to g^ve the result he himself desires. 

In the instance mentioned at the opening of this paper, the 
rate set had proved unsatisfactory. However, it was impos- 
sible to determine whether the rate had been set too low; or 
whether the girls who were doing the work were of unusually 
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low ability; or in fact, where the real difficulty lay. The ex- 
periment described here was conducted in an attempt to cast 
further light on this problem. 

The eighty bullet inspectors were all employed at the same 
kind of work. The first object of the experiment was to dis- 
cover how these prls compared with other inspectors who 
were doing similar work in other shops of the same company. 
The comparison was to be based upon a set of tests which had 
already been given to large numbers of inspectors in other 
shops. Two tests were pven to each girl, the Woodworth- 
Wells cancellation test and the Woodworth-Wells number 
group checking tests. These two tests had been found very 
significant in previous experiments with inspectors, having 
shown consistently high correlations.* The two tests were 
given to each girl at her work bench and occupied about ten 
minutes for each subject. Forty-two of the eighty inspectors, 
selected at random, were tested in this way. It was taken for 
granted that the other thirty-eight subjects would not mate- 
rially alter the averages obtained. The average performance 
of the forty-two bullet inspectors in these two tests was then 
compared with the average performance in these tests found 
for other groups of inspectors. The figures on which this 
comparison was based are given below, the results of the 
present experiment being put last: 

Inspecting Tests Given No. of Girls Av. Perf. in Av.Perf. in 
Shops in I9I7 Tested no. Group Cane. Test* 

Test 

A 

AI 

B 

C 

D 

E 

The comparison showed that the bullet inspectors were poorer 
than any other group of inspectors in the number group check- 
ing test (the test which had shown the most significant cor- 
relations in previous experiments), and poorer than any other 
group but one in the number cancellation test (the next most 
significant test). It was inferred from this that the dissatis- 
faction of the bullet inspectors was probably due to this com- 
parative inferiority rather than to the lowness of the rate. 
However, the experiment did not conclude with this inference. 

1 The details of these experiments are described in the writer's book 
on Employment Psychology. 

2 Corrected time in seconds. 
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136 
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42 


191 


139 
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After a girl had been tested and the observer had picked 
up his materials, he would ask in a casual way, " How 
are you making out ? " Of the number of girls asked, sixteen 
expressed themselves as not doing well or as being often dis- 
couraged, and only five expressed satisfaction. The rest were 
incoherent or inconclusive. This pointed to a more or less 
general dissatisfaction among the girls. It was obviously un- 
fair to attribute all of this dissatisfaction to the existing rate. 
Further observation revealed the following contributing causes : 

First, when a box of improperly inspected bullets was found, 
it was returned to the inspector for reinspection and had to 
be inspected again without pay. This was customary and ex- 
pected. However, in the Bullet Inspecting Shop the boxes to 
be re-inspected were usually held back until 5 o'clock in the 
evening and only then returned to the careless inspector. In 
this way a girl, laboring under the impression that she was 
about to earn a good day's pay, might suddenly find herself, 
near the end of the day, confronted with a box or two of 
bullets which would have to be done over without pay. This 
spoiled her day and was quite likely to make her discouraged. 
It was therefore recommended that all work to be re-inspected 
should be returned to the inspector as soon as possible after 
being discovered, in order that the punishment might be as 
closely associated with the mistake as possible and in order to 
avoid ending the day with a discouraging incident. This 
recommendation was followed. In addition it was ordered 
that no bad work should be returned for reinspection after 
3O0 P. M. 

Secondly, it was observed that the bullets to be inspected 
were given to the inspectors in boxes holding as much as eighty 
pounds or more. It took about two hours to inspect one box, 
and five or six boxes constituted a day's work. When the 
check inspector found a few bad bullets in a box that had been 
inspected, the whole box must be returned for reinspection. 
This meant that about one-fifth of the inspector's whole day's 
work had been in vain and consequently she was likely to be- 
come still more discouraged. It was therefore recommended 
that the quantity of bullets in a box should be cut in half, 
and forty instead of eighty pounds given to a girl at one time. 
In this way, ten or twelve boxes would constitute a day's work ; 
and if a girl worked carelessly at one time, so that a box of 
bullets was returned to her for reinspection, she would suffer 
only half as much as before. At the same time she would 
receive a warning which would give her an opportunity to 
avoid repeating her mistakes. 
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Thirdly, it was observed that the inspection required unusu- 
ally fine eyesight. Investigation showed that 19% of all the 
work inspected was returned for reinspection. This was a 
factor to be taken into consideration in making a final adjust- 
ment of the rate. 

Fourthly, the observer discovered that a practical embargo 
had been placed on the amount of work the inspectors were 
allowed to do. The limit set was seven hundred pounds. 
This limit was set on the supposition that a girl could not in- 
spect more than seven hundred pounds and do them well. 
Aside from the fact that this ruling was in total contraversion 
of the piece-work principle, it also served as a discouragement 
to the very fast inspectors, who chafed imder such a limita- 
tion. This limit was removed. 

These observations, while not strictly psychological — that is, 
in the technical sense — nevertheless were directly traceable to 
the psychological attitude. Moreover, they were a distinct 
contribution to the solution of the problem. 

If the tests had not been made, it might have been arbitrarily 
decided that the rate of pay was high enough, in which case 
the work of the shop might have suflfered a decided detriment. 
Or it might have been arbitrarily decided that the rate was too 
low, in which case the production of the shop might not have 
been increased and the real root of the difficulty would have 
been ignored. Either course would have proved unsatisfac- 
tory to one group of claimants or the other. The results of 
the experiment gave a concrete and well-founded reason for 
maintaining the existing rate, at least for the time being or 
until the effects of the supplementary changes recommended 
could be observed. As a matter of fact, it was unnecessary 
to change the rate, in spite of the fact that results in the tests 
indicated that the bullet inspectors were not as capable as the 
other inspectors. 

This experiment suggests certain broad potentialities of in- 
dustrial psychology. The problem of setting rates is a uni- 
versal industrial problem, and it is one of tiie most delicate 
and trouble-making questions with which industries have to 
deal. The time-study method, which is aimed chiefly at in- 
creasing production, can be distinctly supplemented by the 
psychological method. There is no antithesis or contradic- 
tion between the two methods for, as the above experi- 
ment clearly shows, a psychological study as well as a time 
study, may contribute materially to production. Moreover, 
in contrast with the usual procedure, an increase in satisfac- 
tion and in production may sometimes be effected without an 
increase in the rate of pay. 
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TENTATIVE NORMS IN THE RATIONAL LEARN- 

ING TEST^ 



By Joseph Peterson, Peabody Coll^^ for Teachers, Nashville, Tcnn. 



The present test was devised by the writer as a special study 
in learning, primarily. It was soon found that it is a rather 
good means of determining one's intellectual ability and also 
that it has useful diagnostic values as to certain kinds of 
traits, particularly degree of rational organization and of sub> 
jectivity of mind.^ " The reaction required of the subject is to 
associate in a random order the numbers 1 to 10, inclusive, 
with the first ten letters of the alphabet. This is to be done 
by means of a series of guesses the range of which may be 
greatly limited by the use of a rational organization of the 
situation. Each subject completes the learning at a single 
practice period, varying in length inversely with the subject's 
ability, roughly speaking. As will be seen, the subject is 
forced to react to a changing situation, each response making 
it different to a slight degree by limiting the range of proba- 
bility." The test at present can be used only as an individual 
test, but in this use it has some advantages over other indi- 
vidual tests: it is easy to give to a subject, the methods of 
presentation of the situation and of scoring results being ob- 
jective. No printed forms other than a paragraph of in- 
structions are necessary; the tester writes on tihe test sheet 
the necessary headings, the name of the subject, date, time of 
beginning, etc, while the subject reads the instructions. The 
time of beginning is the time at which the tester first calls out 
" A ;" the subject is allowed as much time to read the instruc- 
tions as is necessary, and should be encouraged to re-read at 
least once. Finally it is possible to increase the difficulty of 
the test to any desired point, by the addition of letters. 

^Read before the Southern Society for Philosophy and Psychology 
in the New Orleans meeting, April 23, 1920. 

> See Experiments in Rational Learning, Psychol Rev., 1918,25,443-467. 
A report on correlations with work in psychok)^ will appear in the 
March, 1920, number of the Journal of Educattonal Psychology. A 
modified form of the experiment has been used by Sunne, Psychol. 
Bull., 1919, 16, 262-267. 
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The norms in this report were obtained with the form of 
the test shown in Table I, ten letters being used, numbered as 
there shown. More detailed instructions as to the giving of 
the test are to be found in the first reference in note 2. 

TABLE I 
Name, L. D. Time beginning, 9:40; time ending 9:52 





A 


B 


C 


D 


E 


¥ 


G 


H 


/ 


{_ 


Errors 


Letters 


Unclas- 


Lof. 


Pter. 


Total 


Numbers. . . . 


9 


6 


2 


10 


8 


1 


5 


4 


7 


sified 


X 


« 




Firat aeries 


"i" 


8 


5 


"i" 


8 


7 


lOx 


lOx 


^ 


3 












5 


7 


3 


7 




5 


3 


3 


3 














1 


10 


1 


10 




4 


5 


Iz 


7 














2 


3 


7 






1 




7 
















9 


1 
6 


10 
9z 

4 
2 










Gz 

9z 

2z 

7* 

9x* 

2z« 

4 






35 


10 


3 


48 


SwoDd aeries.... 


2 


6 


10 


9x 


7 


7 


7 


5z 


7 


9z 












6 




9z 


7 


9z 


5 


3 


9z 




lOz 












8 




2 


10 


8 


3 


5 


7 




«z 












4 










9z 




5x« 




8x 












1 










1 




7* 




2z 












9 














9x* 
lOz 
6z 
9x* 
6x* 
4 




Ix 
3 


33 


18 


5 


56 


Tlurd aeries 


8 
6 
9 


2 

4 
8 
10 
1 
7 
8* 
6 


10 

1 

8 

6x 

3 

7 

5 

8* 

6x 

5* 

4 
10* 

2 


10 


7 
5 
3 

1 
8 


1 


7 

3 

4 

2z 

5 


4 


3 

7 


3 


30 


3 


5 


38 


Fourth aeries. . . . 


9 


6 


2 


10 


8 


1 


5 


4 


7 


3 














Fifth aeries 


9 


6 


1 
8 
2 


10 


8 


1 


5 


4 


7 


3 


2 








2 


Sixth and seventh 






























•eriee oorrect. . 






























U.C. Errors 


11 


iT 


23 


4 


6 


7 


T 


20 


3 


6 


100 








z Errors (log.) 








4 


1 


1 


1 


2 


15 


1 


6 




31 






*Errora(per.) 





1 


4 














8 












13 




Totals 


11 


13 


31 


5 


7 


"i" 


10 


43 


4 


12 








144 



Seote: 12 min.; 7 repetitions; 144 total errors. 
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The following typewritten instructions are given to the sub- 
ject to read: 

The letters A, B, C, D, E, F, G, H, I and J are num- 
bered in a random order from 1 to 10. I cail out the 
letters in their order and you are to guess numbers for 
each letter till you get the correct one, when I say " right." 
Then I call out the next letter; and so on. This con- 
tinues till you get each number right, the first guess, 
twice in succession through the series from A to J. Then 
you are through. You must ask no questions, but are to 
use all the mental powers at your conunand in order to 
complete the learning as soon as possible. You will be 
ranked by (1) the total time you take, (2) the number of 
errors, or wrong guesses you make (every number you 
speak being a guess), and (3) the number of repetitions 
from A to J that you require for the learning. Re-read 
these instructions carefully if necessary to understand 
what you are to do. The meaning will be clearer as we 
go on with the experiment. 

Caution. When you get through with this experiment 
please do not say anything about it to others who may 
take it, as doing so might make it easier for them than 
for you. 

When the subject is ready to start, the tester notes down 
the exact time in minutes and calls out "A." The subject 
usually stops after the first guess, and has to be told to go 
on till he gets the right number. In time the tester does not 
say " right " when the correct number is given, but will find it 
best just to call out the next letter. Every guess the subject 
clearly speaks out is recorded in a column just under the 
letter. It is common for subjects to reject certain guesses 
just after they have been made. This rejection should be 
noted by some symbol, but the number should be retained. 
People so often speak, and think afterwards ! When the test 
is completed the time must be recorded immediately. Errors 
are then marked and counted, and the individual record will 
have the form shown in Table I. Logical errors are errors of 
guessing a number that has already been used for an earlier 
letter in the series, marked by an x in the record; and per- 
severative errors, marked in the figure by an asterisk, are 
errors of repeating a guess while reacting to any pven letter. 
In indicating errors on the original record, logical errors may 
be checked and perseverative errors enclosed in a circle. 
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In addition to these quantitative records, it is well to note 
down, just after each test is completed, anything striking in 
the subject's method of going at the solution of the problem. 

In this test several kinds of results are obtained, any one 
of which may prove to have diagnostic values, either of gen- 
eral intelligence as we now vaguely conceive it or of other 
rather general traits related in important ways to success in 
certain of the larger divisions of human activity. One does 
not, for instance, think of salesmen as being highly subjective- 
minded and over-conscientious. We have not attempted, 
therefore, to combine the scores in time, number of repetitions, 
and errors of the various kinds mentioned, into a single scale. 
It has been fotmd, moreover, that some of these scores are far 
from being distributed about a mean in the form of the normal 
curve. This lack of so-called normality in distribution is par- 
tictdarly evident in the perseverative errors, and to a consid- 
erable extent also in the number of repetitions. In the former 
case the mode is at zero errors, and in the latter, at six repeti- 
tions, the smallest number of repetitions made by any subject. 
Neither time nor error data of the three other kinds shown in 
the table — uc, log., and total errors — ^approximate closely to 
the normal distribution. The reasons for this are to be sought 
partly, at least, both in the unfair sampling of college students 
as representative of the average adult mind (as is shown by a 
study of the regression lines, in the second reference indicated 
in note 2) and in the mental inequality of the steps of our 
scales. Illustrating this mental inequality of steps, we may 
say that the difference between a score of 36 and 86 total 
errors is greater than that between a score of 383 and 433, 
though the absolute difference in both cases is fifty. 

To get a table of norms that presents all the possibly signifi- 
cant kinds of data, and also that does not rest its validity on 
an assumption of normal distribution, we have constructed a 
percentile table of the different kinds of scores shown in Table 
II. These norms are based on the records of 113 college 
students, mostly sophomores in psychology in the writer's 
classes. Eighty-one of the subjects were University of Min- 
nesota students in the College of Science, Literature and the 
Arts, and were tested in the spring of 1918; and thirty-two 
were Peabody students, tested in the latter part of the winter 
quarter, 1920. The tests were given by the writer and an ad- 
vanced student in the former case, and extended over a period 
of a week ; and in the latter case by the writer and three stu- 
dents, all during the same day. Precautions were taken against 
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TABLE II 

Percentilb Norms in Rational Learning— Adults 
(Baaed oa 113 Cases) 



Per- 
centile 


Nfin- 
utes 


Repe- 

titkniB 


Emxs 


Uc. 


Los. 




Total 


100 
90 
80 


6 

10.3 
11.6 


6 

7.1 
8.8 


34 
65 
81 


2 
15 
22 




.8 
2.0 


36 

86 

111 


75 


12.3 


9.5 


90 


26 


2.7 


117 


70 
65 
60 
55 


13.0 
14.3 
14.9 
15.5 


10.2 
10.8 
11.3 
11.8 


95 
103 
117 
131 


30 
34 
41 
43 


3.4 
4.5 
7.3 
8.5 


129 
146 
172 
185 


50 


16.1 


12.4 


146 


51 


9.4 


204 


45 
40 
35 
30 


17.7 
19.5 
20.5 
21.8 


13.0 
13.5 
14.3 
15.4 


160 
170 
194 
210 


55 

60 
67 
82 


10.2 
11.0 
12.5 
14.8 


223 
235 
277 
310 


25 


23.4 


17.1 


225 


95 


17.9 


331 


20 

10 




26.5 
34.7 
60.0 


17.8 
20.7 
33.0 


256 
356 
780 


102 
148 
335 


20.7 
30.9 
61.0 


383 

523 

1160 



coaching, and there was no evidence whatever that any student 
coming to take the test knew an)rthing of importance about it 
before seeing the instructions. Not all the students in tiie 
classes from which these subjects were taken were tested, but 
only those who could arrange favorable hours. Of the Min- 
nesota classes — three sections — 70 per cent, and of the Pea- 
body classes only 60 per cent, were tested. There seems, how- 
ever, to be no evidence of unfair sampling. Illness in the 
latter case prevented the testing of all the students. There is 
evidence that the Peabody group is composed of a more highly 
selected body of students than is the Minnesota group, for 
upon averaging the percentiles in time, repetition, and total 
error scores by the two groups, we found that the Minnesota 
median is passed by about 65 per cent of the Peabody group. 
The norms of the combined groups are probably rou^y rq)- 
resentative of college students. It is evident, of course, that 
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the percentiles become less reliable as they are further re- 
moved from the median, the 50 percentile. 

Correlations of results of the Rational Learning Test with 
scores in psychology examinations, and correlations of ranks 
in this test with ra^s in the Otis Group Intelligence Scale and 
with ranks in the Army Alpha test, though yet based on an 
insufficient number of cases to have a high degree of relia- 
bility, indicate that the best measure of the subject's general 
intelligence is that which takes note of all the criteria men- 
tioned in the instruction sheet — ^time, number of repetitions, 
and number of errors. But even then several methods may 
be used, each giving relatively different weight to these various 
factors and even to the diflferent classes of errors described. 
For instance, we may find the percentile of the number of 
minutes, of the number of repetitions, and of the total errors, 
and average these ; or we may take twice the percentile of the 
number of total errors and divide the sum by four, thus giving 
double weight to the errors made by the subject as against the 
time taken and the number of repetitions. Any other weight- 
ing of these three factors is, of course, possible. In consid- 
ering errors, moreover, we may simply consider the unclassi- 
fied errors, or we may give extra penalty for logical and per- 
severative errors, according to any one of several means con- 
ceivable. Each of these methods will give ratings of subjects 
slightly different from those derived by the others. But the 
differences are, after all, not as great as might be expected; 
for more time also means more errors and more repetitions, 
as a rule; on the whole, high ranking on any one of the cri- 
teria means high ranking on the others. The correlation be- 
tween rankings by unclassified errors and total errors is but 
very slightly below 100. I got .99 with 81 subjects, the total 
error score being slightly better than the unclassified error 
score. The correlation is also very high between ratings in 
the Rational Learning Test when the total errors are counted 
on the one hand, and when total errors, minutes, and repeti- 
tions are considered on the other. In this case with twenty- 
nine subjects recently tested I got a correlation of .88, the 
better rating being obtained by the three-criteria method. 
While it is hardly possible at present to arrive at even a 
practical final judgment as to which criteria in the Rational 
Learning Test are most serviceable for the measurement of 
general intelligence, the best method appears to be simply to 
get the average of the percentiles of total errors, number of 
minutes, and number of repetitions. This measure is easily 
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derived by the use of our percentile table. For example, the 
record of L. D. in Table I shows 144 total errors, 12 minutes, 
and 7 repetitions. The corresponding percentiles, as found in 
Table II, are: 65, 75, and 90, respectively. We simply take 
the approximate percentiles, the nearest multiple of five, as 
the tables are not yet accurately enough standardized to war- 
rant taking the extra time for finding the exact percentile. 
Even to take the nearest percentile shown in the table is justi- 
fiable by the fact that the extremes — above 80 and below 20 — 
are less accurate than are those nearer the median. R. L.'s 

percentile rank is therefore 65 -[-• 75 -}- 90 -- The general 

equation is 3 

p^^Fte + Pm±Fr 

PR is for percentile rank ; P, percentile ; and the small letters 
in the numerator, te, m, and r, are for total errors, minutes, 
and repetitions, respectively. 

But in individual diagnosis it is not well to stop with one's 
general rating. We see that R. L. is ranked in the upper 25 
per cent of college students, but in unclassified errors he sur- 
passed only 65 per cent of college students, in logical error and 
perseverative error scores, 70 and 35, respectively. He is 
considerably below the median in perseverative errors. This 
probably indicates a subjectivity of mind, further data regard- 
ing which should be sought in the notes on his general behavior 
during the test, and in the detailed record of his responses, as 
shown in Table I. He collected himself very readily after 
confusions in the third series, and in the fourth made a per- 
fect record, though two errors were again made in the fifth 
series. Notwithstanding confusions here and there, probably 
due to subjectivity of mind, R. L. seems to fall with the more 
logical, as opposed to the trial-and-error type of individuals. 

The rank of a group can be obtained by finding the median 
percentile rank (PR) of all the members, and the various 
methods of comparing groups may be employed if the PR of 
each individual is taken as his score. 

Other forms of the Rational Learning Test with ten letters 
may be obtained by making up a diflferent order of the num- 
bering of the letters, but in doing this care should be taken 
not to follow any subjective order that may be of aid to the 
subject. The norms here given apply only to the numbering 
shown in Table I, though they may be found to be fairly 
accurate for other forms. We have found no trouble with 
coaching thus far, but intend to standardize the test in at least 
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two forms for diflferent afi;es. This will not only aid in pre- 
cautions against coaching but will add materially to the value 
of the test for various purposes. It appears desirable to use 
fewer letters in the test for children of the g^rades, as the 
present form is too hard for them. The median time for 
adults on the present test is slightly over sixteen minutes, and 
the determination of the subject's percentile rank after the 
test requires but a very short time. 

If the test proves to be sufficiently worth while to warrant 
finding the subject's IQ, as used by Terman, this measure can 
readily be determined from the use of a table such as is given 
in the Otis' Group Intelligence Scale, Manual of Instructions, 
One must exercise caution in attempting to work out IQ's 
from standards derived from tests of college students, who 
compose a rather highly selected group. 

The Rational Learning Test has been used in modified forms 
by Stmne, to whose report we have already referred, and by 
B. F. Haught. Sunne had twelve keys numbered in a random 
order, and so arranged that when key 1 was pushed a lamp 
would light; when this had been located, key 2 would next 
light the lamp; and so on. In this form spatial and other 
factors enter making results hardly comparable with those 
which we have presented here. Mr. Haught's method is to 
have ten keys under each of the ten letters we have used, one 
key under each letter being connected with a battery so as to 
ring a bell if pushed. No results by this method have yet 
been published. It is desirable in any such scheme as this to 
have some sort of self-recording apparatus; and it seems to 
be within the range of probability to have devised in time a 
machine with which the subject can be left wholly alone, and 
which will record in a convenient form, and in order of occur- 
rence, all his significant responses. In the making of such a 
contrivance careful consideration should be given to the pos- 
sible operation of spatial factors, as opportunity for space 
habits will reduce the difficulty of the problem for most per- 
sons. The present form of the experiment, however, whether 
used as a test or as a study of a higher form of learning, is 
not only convenient and highly objective in procedure so far 
as a study of the higher thought processes is concerned, but 
it also eliminates rather successfully the influence of spatial 
habits. 
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A SHORT POINT SCALE FOR MENTAL MEASURE- 

MENT 



By EsTHEs Resdy and James W. Bridges, Ohio State University, 

Columbus 



The increasing demand for intelligence ratings of large 
numbers of children and adults has resulted in the develop- 
ment of group examinations which are of undoubted validity 
and sufficient accuracy for the great majority of cases. How- 
ever, these group examinations cannot yet entirely replace 
individual examinations. The latter are still necessary in the 
more careful diagnosis of subnormal, feeble-minded, and psy- 
chopathic cases. It seems possible however to reduce greatly 
the time required in giving such examinations. This could 
be done by selecting from one of the standard scales the tests 
of greatest diagnostic value and creating therefrom a short 
scale more or less comparable in reliability to the original. 
The present study was undertaken with the object of pro- 
ducing such an abbreviation of the Yerkes-Bridges Point Scale. 

The data for the study were Point Scale examinations of 
five hundred and forty-one children between the ages of four 
and fourteen years. Two hundred and forty of these children 
were examined in the Psychological Clinic of The Ohio State 
University. The remaining three hundred and one were ex- 
amined by L. E. Coler in two Columbus schools, one of su- 
perior and the other of inferior social status.^ The chrono- 
logical age and Point Scale score distributions of five hundred 
and forty-one cases are given in Table L 

The selection of tests for the short scale was based upon 
the following principles : correlation of test scores with whole 
scale scores, practical suitability, and relative difficulty. The 
relation of test scores to whole scale scores is indicated roughly 
in Table II which gives the median scores on the entire scale 
for subjects who make each score on each test. This table 
should be read in the following way: the median Point Scale 
score of subjects who make zero on test 1 is 40 points, the 
median Point Scale score of subjects who make 3 on test 5 is 

1 Bridges, J. W., and Coler, L. K : The Relation of Intelligence to 
Social Status, Psych. Rev., 24, 1917, pp. 1-31. 
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TABLE I 




Oiioii. 


No. 


Point Scale 


No. 


Age 


Cases 


Score 


Cases 


4 4-5 


2 


0- 4 





4-6-4^11 


3 


5- 9 


1 


5 5-5 


3 


10- 14 


2 


5-6-5-11 


9 


15- 19 


4 


6- — 6-6 


33 


20-24 


15 


6-6-6-11 


66 


25-29 


26 


7 7-5 


38 


30-34 


14 


7-6- 7-11 


46 


35-39 


29 


8 6-5 


37 


40-44 


45 


6-6-8^11 


45 


45-49 


57 


9 9-5 


30 


50-54 


76 


9-6—9-11 


24 


55-59 


75 


10-— 10-5 


24 


60-64 


58 


10-6—10-11 


25 


65-69 


45 


11- —11-5 


31 


70-74 


39 


11-6—11-11 


27 


75-79 


34 


12 1^-6 


27 


80-84 


9 


12-6-12-11 


26 


85-89 


3 


13 ia-6 


22 


90-94 


7 


13-6-13-11 


23 


95-100 


2 


Total 


541 




541 



52 points, and so on. The amount of correlation was deter- 
mined roughly by inspection of Table II. The range of the 
median scores in each test and their uniform increase as the 
test scores increase are the significant factors. 

Certain tests which fulfill the correlation criterion were 
rejected on other grounds. Test 6 was omitted because it 
measures the same function as test 4, immediate memory ; and 
test 4 has the advantage of uniform gradations in scoring. 
Similarly tests 10 and 19 measure ability to define. Test 10 



TABLE II 
Median POINT ScALB SooRBS or Subjects Making Each ScoKB ON Each Test 


Te«t 


1 2* 3 4* 5 6 7 8 9* 10* 11 12* 


13 14 15* 16* 17* 


18 19 20* 


Score 


1 
2 
3 

9 


40 17 — 2529255 422432 4628 
28 30 46 27 36 32 — 50 28 25 52 38 
30384056 44 545 593824 5650 
56 50 56 56 52 — 34 — 48 40 62 58 
— 58 — 62607236 — 5248 — 66 

68 42 — 58 58 

82 54 — 68 58 

89 64 

66 68 


36 45 33 42 42 
42 — 32 52 51 
58 58 46 60 58 
68 — 54 64 61 
74 68 58 68 70 

72 — 78 

64 — — 

74 — — 

82 


46 48 38 

— 50 54 
51 60 58 

— 52 70 
70 72 72 

— 82 83 
76 88 94 





•TetU telected for Short Scale. 
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was pven the preference because the selection of test 19 would 
tend to overweight the short scale with difficult tests, while it 
is obviously necessary to keep the short and long scales com- 
parable in difficulty throughout the entire range. Test 7 was 
rejected because of its inability to discriminate in the lower 
levels of the scale, and also because of the personal equation 
in scoring. Test 13 was rejected because the time required 
for giving it (three minutes) does not correspond to its rela- 
tive value in a short scale. The tests finally selected for the 
short scale are given below together with the maximum points 
credit for each test and the number of each test in the original 
Point Scale. 

Test Points 

2. Missing parts 5 

4. Memory span for digits 5 

9. Comparison of objects 6 

10. Definition of concrete terms 8 

12. Copying square and diamond — 4 

15. Compfdiension of questions 8 

16. Drawing designs from memory.. 4 

17. Criticism of absurd statements.. . . 5 
20. Analogies 5 

Total short scale score 50 

The scores of the five hundred and forty-one subjects on 
this short scale were determined and compared with their 
scores on the entire scale. This comparison is shown in the 
correlation array, Table III. The Pearson product-moment 
coefficient of correlation is .95, which indicates that this short 
scale of nine tests is a fairly accurate measure of those func- 
tions measured by the entire scale. Correlations between 
chronological ages and scores were also computed. In the 
case of the entire Point Scale the coefficient was found to be 
.67, and in the case of the short scale, .64. 

The relation of long scale scores to short scale scores was 
found to be approximately two to one. This is shown by 
inspection of the correlation array. Table III. It is also 
shown by comparison of percentile ranks. For example, the 
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TABLE III 

Thb Comolation Bbtwibn Scdos ON THB Okiginal Point Scale and Scorbs on 
THB Short POINT Scale 



P6int 
Scale 










Sliort Scale Scores (0-1. 


2-3. 4-6, 


etc.) 












Scores 


24 


6! 


no 


12 


14 


16 


18 


20 


22 


24 


26 


28 


30 


32 


34 


36 


38 


40 


42 


44 


46 


48 


Total 


95-100 
90- 94 
85- 89 
80- 84 
75- 79 
70- 74 
66- 69 
60- 64 
55- 59 
50- 54 
45- 49 
40- 44 
35- 39 
30- 34 
25- 29 
20- 24 
15- 19 
10- 14 1 

5- 9 

0- 4 


11 

1 
1 


1' 

1 ] 


6 

7 5 
I 


1 
11 
2 


5 
9 


6 
6 


1 
4 
9 


9 
9 
12 

1 


1 
15 
12 
18 
2 
1 


2 

6 
20 
24 
11 


1 
2 
18 
20 
9 
1 


1 
1 
9 
20 
13 
1 
2 


1 

1 

11 

21 

18 

7 

1 


3 
11 
7 
8 
1 


4 

7 

10 

11 

3 


1 
6 
9 
10 
4 
1 


1 
7 
12 
1 
2 


11 
5 


1 

2 
4 
2 

1 


2 
1 

3 


4 
3 


1 
1 


2 

7 

3 

9 

34 

39 

45 

58 

75 

76 

57 

45 

29 

14 

26 

15 

4 

2 

1 


Total 1 


13 


21 


Ul 


14 


14 


12 


14 


31 


49 


63 


51 


47l60 


30 


35 


31 


23 


16 


10 


6 


7 


2 


541 



seventy-five percentile rank is 66 points for the long scale, 34 
for the short; the fifty percentile rank is 56 points for the 
long scale, 28 for the short; and the twenty-five percentile 
rank is 45 points for the long scale, 23 for the short. The 
score on the short scale can consequently be multiplied by two, 
and the result interpreted in terms of mental age by the stand- 
ard Point Scale norms. 

The short scale scores of the five hundred and forty-one 
subjects were multiplied by two and compared with their long 
scale scores in order to determine the deviation of the former 
from the latter. The median deviation disregarding signs is 
3.9 points, but a deviation of 2 or less was found in two 
hundred and five cases. A distribution of the deviations over 
the whole range of the scale taking signs into account shows 
that the deviations tend to be minus in the ranges from to 
29, zero from 30 to 69, and plus from 70 to 100. Comparing 
these ranges with the standard age norms of the original long 
scale it seems that in determining mental ages from 6 to 12 
years the short scale does not deviate greatly from the long 
scale, but that considerable deviations are found in the lower 
and higher ranges. 
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G)NCLUSIONS 

An abbreviation of the Point Scale consisting of nine tests 
with a total score of fifty points has been presented. This 
short scale can be used in schools, hospitals or elsewhere when- 
ever time does not permit the use of the complete scale. The 
sum of the scores on these nine tests can be multiplied by two 
and interpreted by the usual Point Scale norms. If the result 
is not deemed satisfactory the subject mav afterwards be given 
the remaining tests of the original scale. This will merely 
involve a slight change in the order in which the tests of the 
scale are given. 

Comparison with the complete scale seems to show that this 
short scale gives fairly reliable results within the limits of six 
to twelve years. Scores on the short scale give a high cor- 
relation with scores on the complete scale, and the former 
correlate almost as high as the latter with dironological ages. 
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A STANDARDIZATION AND WEIGHTING OF TWO 
HUNDRED ANALOGIES 



By Rudolph Piktner, Ohio State University, and Saicubl Rekshaw, 
Western State Normal School, Michigan 



Of all the various forms of controlled association tests the 
mixed relations or analogies test is known to be one of the 
most useful and reliable. It differs from certain other asso- 
ciation tests in that the form of the response is restricted. 
This restriction varies from one stimulus to another within 
the series of terms, and its nature is not revealed to the sub- 
ject in the instructions but is supplied by the material and 
must be perceived by him from the material (6). Its wide- 
spread use in some form or other, has seemed to justifv a 
somewhat more extensive weighting and standardization than 
has been attempted up to this time. 

The form of the analogy seems to have had its origin with 
the Aristotelians, and it has come down to us through logic 
and formal grammar. Among the earliest attempts to use the 
analogous relation, its perception and completion, as a mental 
test was that of Woodworth and Wells (1). Similarly it was 
used by Whitley (2) in her study of the validity of various 
forms of association tests in respect to practice effect, varia- 
bility and intercorrelation ; by Burt (3) who gave the name 
analogies to the test; by Bri^s (4) in his study of the disci- 
plinary effects of instruction in grammar on the higher men^ 
processes of school children; by W)ratt (5) in comparing abili- 
ties of Manchester children of various ages ; by Bingham and 
Whipple (6) with American college students. More recently 
the test has been employed by Whipple, Henry, Manuel and 
Coy (7) for the selection of gifted children, by Rogers (8) 
in her tests for the diagnosis and prognosis of mathematicd 
abilities, in the Otis Absolute point scale (9) and the Otis 
Group Intelligence test; in the Army Alpha tests; by Thur- 
stone in his tests for college Freshmen and High School 
Seniors; by Yerkes, Bridges and Hardwick (14) in their 
Point Scale ; by Thomdike (the pictorial and geometric form 
of the test) in his Non Verbal Intelligence Scale (15) ; by 
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the Bureau of Salesmanship Research, and in many "omni- 
bus " test groups. 

Woodworth and Wells (1) claim the test measures "skill 
in handling associations/' "flexibility of mental perform- 
ance;" Burt (3) "perceptions, implicit or explicit, of the 
relation and reconstruction of the analogous one by relative 
suggestion;" Briggs (4) "rapidity and accuracy of mental 
reorientation," the " functioning of meaning tendencies." 
Whipple (7) is "confident that the analogies test brings out 
an ability that is decidedly S3rmptomatic for the purpose of 
selecting gifted children." Wyatt (5) and Bickersteth (10) 
speak of it as a test of discrete reasoning. 

Until the comparatively recent development of group test- 
ing, the lists of Woodworth and Wells, and of Whipple and 
Fraser, comprising some 20 single analogies to each list, were 
most commonly used, and this most frequently as an individual 
test wherein the association reaction time played a very im- 
portant part. 

There are two possible ways of scoring analogies : 

1. To give credit according to the time required to find 
the analogy; 

2. To give credit according to the difficulty of the 
analogy as determined by a standardization based upon 
the percentage of passes or failures. 

Green (11) found such a high correlation (r=.87) be- 
tween time as a measure of difficulty and the percentage of 
passes and failures, that it would seem best to follow the 
second of these methods. In general the scheme of weighting 
outlined by Rugg (12 and 13) was the one adopted in this 
study. 

In making up our list of analogies we made selections from 
every available existing list, pidcing out the best ones and 
avoiding duplications as far as possible. A few original ones 
were added. After trying out in a preliminary way a large 
number, we finally selected two hundred and had them printed 
on a four-page folder, with fifty on each page. Ten point 
type was used for the first three terms, followed by four or 
five " choice " words, printed in bold-face type of the same 
size. A specimen of the original list is shown below : 

51 better— good : : worse— very-good medium bad much-worse best 

52 grassy-cattle : : bread— batter flour milk man horses 

53 Urge— object :: loud— soft small heavy weight sound 

54 king— kingdom :: president— vice-president senate republic 

queen democrat 
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55 Man — revolver : : bee— wings honey flying wax tting 
^ egg— bird : : plant — teed shell leaf root feathers 

57 ignorance — education : : poverty — ^lasiness school wealth charity 

teacher 

58 circle — square : : sphere — circnmf erence cube round comers ball 

59 point — ^line :: line — surface pencil dot curve solid 

60 disease — sanitation : : accident— doctor hospital bandage cleanli- 

ness care 

61 ordinary — exceptional : : many— all none few common more 

The subject is required only to underscore one of the choice 
words in black type to complete each analogy. Otis (9) has 
called attention to the fact that the chance-success factor in 
this procedure is more than atoned for by its ease of adminis- 
tration and scoring. Retrial with some of our subjects sub- 
stantiates this view. No attempt was made in the limits of 
this study to deal with the pictorial or geometric forms of the 
test, devised and used by Thomdike (15) and by the National 
Research Council tests. Neither did we attempt, except in a 
superficial way, to try the construction of new and original 
analogies as a test. These are problems by themselves which 
would require special study and research. 

The instructions to the subjects, after the usual preliminaries 
and samples, were in part : " You are to discover in what way 
some word among those in black type has the same relation 
to the third word in the series as the first and second have to 
each other. Then draw a line under that word. If you do 
not see the relation in about 8 seconds or are in doubt about 
it, mark the word that seems nearest it and go on to the next." 
Sufficient time was permitted for the subjects to mark each 
of the two hundred. The work limit method was employed 
with the first 100 subjects. The mean time for this group 
turned out to be about 26.5 minutes for the list. About 7 
seconds is ample time to allow for each analogy in building a 
scale of the tests. It was found that if the subject was un- 
able to perceive the relationship in about 4 or 5 seconds the 
chances were extremely great that never would he be able to 
do so correctly at that sitting. One group of 50 second-year 
College students were asked after completing the list to go 
back over it and carefully check the ones in their judgment 
regarded to be certainly right, wrong or doubtful. After 
scoring the papers it developed that the subject's opinion re- 
garding the correctness or incorrectness of his responses has 
about a one-to-one chance of being right or wrong and so must 
be considered as uniformly unreliable. 
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The subjects numbered 917 in all. Of these there were 47 
graduate students, 100 University Seniors and Juniors, 590 
Normal College first and second-year students, and 180 High 
School students in grades XI and XII. The dironologioil 
ages ranged from 16 to 38 years. To determine whether we 
had a fairly random sampling of intelligence in our subjects 
we took a group of 52 second-year Normal College students 
and tested them with the Otis scale, form A. The scores 
ranged from 87 to 198, with the mediai) at 158, Q, at 172, 
Qi at 151, Q^IO.5 ando- ^6.7. A product moment co- 
efficient of correlation, uncorrected for attenuation, between 
the Otis and analogies scores for these subjects showed 
r =.785 ±.035. 

The ability measured by the analogies test shows rather 
steady and progressive increase with age. Our results shown 
in Table I conform fairly well to those of Bickersteth (10). 





TABT,F, I 






Group 
Graduate Studoits 


Number 
47 


MeanErron 

Of 200 

21.8 


Range 
5-G9 


Normal CoUese 
SeamdYear 


120 


30.5 


6-58 


Normal College 
First Year 


82 


36.3 


8-142 


Hkh School 


97 


35.0 


11-153 


•VIII. Grade 


31 


80.0 


23-200 



*Not included in our group of subjects. 

Wyatt (5) found the test to correlate highly (.80) with 
intelligence. The reliability of the test as shown by him 
for 4^ Oxford girls was: 



Age 


r 


10 


.35±.09 


11 


.62±.06 


12 


.78±.04 


13 


.76±.05 



Bickersteth (10) adds "there does not seem to be much 
difference as the result of practice in the test once its nature 
is grasped by the subject — ^the marks gained in series 2 and 3 
were often identical." 
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Burt (3) concludes that " those tests involving higher mental 
processes such as Reasoning, vary most closely with intelli- 
gence, and are least vitiated by various irrelevant conditions 
such as sex, social status, training of the experimenter, and 
mass measurements of numbers of subjects at once." 

The weights of each analogy were determined by ascertain- 
ing the total number of the 917 subjects who failed each 
analogy. This number was then converted into a per cent 
of the total, by dividing by the number of subjects. Assum- 
ing a normal distribution of the trait measured in a curve 
whose limits are included in a range oi±3fr, setting at — 3 a, 
50 at the mean and 100 at -j-So-, the percentages of failures 
were transmuted into equivalent values of sigma. By the use 
of Rugg's table (12, appendix. Table VI) each was likewise 
assigned a percentile value. 

In addition, each analogy was assigned a point value. This 
point value is purely arbitrary, and calculated in order to ar- 
rive at groups of analogies which are roughly of equal diffi- 
culty. The sum of all the percentile values of the 200 analo- 
gies is 6,002. Dividing this by 1,000, we get a constant 6 
by which all the percentiles have been divided, thus turning 
the percentile values into relative point values. The sum of 
all the point values of the 200 analogies is 1,000. 

In this way we have three possible methods of weighting or 
scoring each analogy. The sigma values give the finest dif- 
ferentiations and lend themselves to as fine a system of scoring 
as may be desired. The percentiles give a somewhat rougher 
method, and the point values still more so. Using either of 
these three methods we may easily construct different lists of 
analogies of equal difficulty. 

We print here the list of 200 analogies arranged according 
to difficulty, giving the percentile, sigma and point values. 
The correct response is italicized. 

POINT VALUE 
Percen- 
tile Sigma 10,0 

62 3.76 heat — a gas : : cold — ice winter zvaier refrigerator 

61 3.68 truth — falsehood :: pride — fear shame honor humility 

60.... 3.64 toil — soil :: pay — check gay debt money 

3.64 darknes — sunlight :: stillness— quiet sound loud dark 
moonlight 

^-^ 
58.... 3.53 point — line :: line — surface pencil dot curve solid 

3.49 oil — toil :: hate — love work boil ate hat 

57 3.47 motion — ^physics:: blood — temperature body veins physic 

ology geography 
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9-0 
55.... 3^ sorrow— misfortune :: joy— grief happiness hatred success 
pride 
332 anger— violence : : \oyt—<oressing hate temper hope happi- 
ness 
3 Jl circle— ellipse : : square— cube curve oval circle diamond 
3 Jl land— wealth : : sun — life earth death moon 
3 Jl evolution — revolution : : crawl— baby floor stand run hands 
and knees 

8.5 

52 3.17 fear— anticipation :: regret — memory hope sorrow hate 

forget 

51 3.11 book— knowledge :: money— paper dollars bank work gold 

50 3.00 Sunday— week :: January— y^or hour Wednesday month 

8j) 
49.... 2.99 moon — earth :: earth — Mars Sun clouds stars universe 
2.97 land — peninsula :: ocean — ^river lake cape gulf water 
2.97 known— unknown : : present — past expensive future Christ- 
mas 

75 

47 2.87 tolerate — pain :: welcome — pleasure unwelcome friends 

give 
2J^ better — good : : worse — very-good medium bad much-worse 

best 
2.84 disease — sanitation :: accident— doctor hospital bandage 
cleanliness care 
46. ...2.77 electricity — ^wire :: gas — flame spark hot pipe stove 

2.76 engineer— chauffeur :: locomotive — ^iron stack engine auto 
2.76 character — important :: complexion — blonde trivial bru- 
nette good 
276 behind — late :: before — after soon early dinner 
45.... 2.70 advice — command :: persuasion— help aid urging compul- 
sion 

7.0 

43 2.62 man — skull :: church — ^umbrella rain Sunday dome 

2.61 ice — ^water : : water— land steam cold river thirst 

2.61 arteries — body : : railroads — country train crossing accident 

2.60 beautiful — ^appearance : : sweet — taste beauty sour ugly nice 

2.60 uncle— aunt :: son — brother daughter sister father girl 

42. . . .2.57 city — ^mayor : : army — soldier navy private general 

2.57 officer — private : : command — army general obey regiment 

2.52 camp— safe : : battle— win field fight dangerous 

6.5 
41.... 2.48 wood— table :: knife — cutting chair fork steel handle 

2.46 rudder — ship :: tail — bird sail dog cat 
40.... 2.44 quarrel — enemy :: agree — policeman agreeable foe friend 
2.40 ordinary— exceptional : : many — all none few common more 
2.40 large— elephant :: loud — soft hear cannon see 
2.40 lion — animal : : rose — small bird phnt thorn 

39 2.38 city— telephone-system :: body— arteries nerves arms 

clothes skeleton 
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6,0 

38 22Z ignorance — education :: poverty— laziness school wealth 

charity teacher 
2.30 circle — square : : sphere — circumference cube round comers 

ball 
229 imitate — copy :: invent— study invention machine originate 

37 227 sand — glass : : clay — stone hay bricks dirt 

2.25 liquid — solid :: water — salt steam lake ice 
225 succeed-fail :: praise — lose friend God blame 

36 2.19 large— object :: loud — soft small heavy weight sound 

2A7 wolf — sheep : : cat— fur kitten dog mouse 

2.16 rafters— house :: skeleton — bones skull grace body 

5-5 

35 2.15 cold — ice :: heat — ^wet cold steam stars 

2.15 success — ^joy :: failure — sadness success fail work 

2.15 past — present :: yesterday— <o(/ay tomorrow Qiristmas 

gone 

2.15 writer — books :: bee — ^hive honey wasp sting 

2.15 mountain — valley :: genius — idiot right think brain 

2.13 tiger — carniverous : : horse — cow pony herbiverous buggy 

2.13 tears — laughter :: sorrow — joy distress funeral sad 

2.12 part — whole :: Indiana — state Ohio Indianapolis United 

States 

2.11 hope— despair :: happiness — frolic fun joy sadness 

2.11 cold — heat :: ice— cream frost refrigerator steam 

34 2.09 Sunday — Friday :: Monday — Tuesday Saturday week 

Thursday 

2.09 eraser — ink :: water — lightning storm dirt clothes 

2.07 dismal— dark :: cheerful — fun bright house gloomy 

2.06 grass— cattle : : bread — ^butter flour milk man horses 

2.06 tgg — ^bird :: plant — seed shell leaf root feathers 

2.05 breeze — cyclone : : shower — bath flood winter spring 

2.04 lion — animal : : rose — smell leaf plant thorn 

33 2.02 Japanese — ^Japan : : Dutch — Russia Holland Siberia Spanish 

2.02 prosperity — happiness : : adversity — success sorrow fun rage 

2.00 arm— elbow :: leg — foot knee stocking toe heel 

2.00 hunter — gun : : fisherman — fish bold wet net 

1.98 music-^noise :: harmony — ^hear accord violin discord 

50 
32. ...1.96 king — kingdom:: president — vice-president republic queen 
democrat 
1.96 bird — song : : man — woman speech boy work 
1.96 peace — happiness :: war — sorrow fright battle Europe 
1.93 horse — mule : : obedient— disgraceful stubborn donkey obey 
31 ... .1.88 electric light — candle : : automobile — carriage electricity tire 
speed glow 
1.88 truth — gentlemen :: lie — rokscal live give falsehood 
1.87 ruler — length :: clock — hour distance time alarm 
1.86 head — hat :: hand — arm glove finger wrist 
1.86 man — boy :: sheep — wool lamb goat shepherd dog 
1.86 peninsula— continent :: bay — Massachusetts boats pay 
ocean 
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30 1^ pretty — ugly :: attract — fine repel nice draw 

1.84 pupil — teacher :: ch\\^-— parent doll youngster obey 

1.84 hospital— patient :: prison— cell criminal bar jail 

1.82 wash— face :: sweep— broom floor straw dean 

1^2 book — writer : : statue — liberty sculptor picture state 

1.82 captain — ship :: mayor — state council city ship boss 

4-5 

29 1.77 eat— fat :: starve — food thin bread thirsty 

1.76 Monday — Tuesday :: Friday — week Thursday day Saturday 

1.76 man — revolver :: bee — wings honey flying wax sting 

1.76 pan — tin :: table — chair wood legs dishes 

1.75 body — food :: engine — wheels fuel motion smoke fire 

1.75 tears — sorrow :: laughter — girls grin joy sob 

1.74 lead — bullet : : gold — paper coin silver copper 

28 1.71 picture — see :: sound — noise music bark hear 

1.71 lobby — ^hotel :: preface — author book porter elevator 

1.70 water — fish:: air — spark man blame breathe 

1.70 man — ^arm:: tree — shrub limb flower bark 

1.69 spoon — soup : : fork — ^knife plate meat cup 

1.68 floor — ceiling :: ground — earth hill grass sky 

27 1.67 Edison — ^phonograph:: Columbus — Spain America Wash- 
ington Ohio 

1.66 poison — death :: food — eat bird life bad 

1.66 singer — song :: preacher — choir organist pulpit sermon 

1.65 abundant — cheap : : scarce — buy bargain costly nasty 

1.64 floorwalker — store :: policeman — fire street conductor 

wagon 

1.64 peeling— banana :: shell — skin orange egg juice ripe 

1.64 foot — man : : hoof — leather shoe cow leg 

1.63 cannon — large :: rifle — ball small bore shot 

1.63 historian — facts :: novelist — fiction Dickens writer book 

1.63 bold — timid :: advance — proceed retreat campaign soldier 

1.63 ear — ^hear :: eye — hair blue see eyebrow. 

4.0 

26 1.60 razor — sharp :: hoe — bury dull cuts free 

1.60 light — dark :: noise — report ring silence sound 

1.59 book — ^author :: statue — sculptor marble model magazine 

man 

1.59 establish — abolish : : begin — work year end commence 

1.59 ocean — ^pond :: deep — sea well shallow steep 

1.58 flag— country : : cross — purgatory Christianity army presi- 
dent 

1.58 December — ^January : : last — first least worst month 

1.57 boy — ^man : : lamb— wool dog sheep shepherd 

1.57 order — confusion : : peace — ^part treaty ivar enemy 

1.57 hat — head : : thimble — finger needle thread hand sewing 

25 1.55 reward — hero :: punish—God everlasting pain traitor 

1.55 hand — arm : : foot — leg toe finger wrist elbow 

1.53 Yes sir — No sir :: always — meanwhile however perhaps 

never 

1.53 confusion— order : : war— guns peace powder thunder army 

1.52 engine — caboose :: beginning — commence cabin end train 
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1.52 10—100 : : lOOO— money io,ooo 20,000 wealth 

1.52 knitting— girls :: carpentry— trade houses boys lumber 

1.52 add— subtract : : multiply— add divide arithmetic increase 

1.52 automobile — wagon :: motorcycle — ride speed bicycle car 

1.51 foot — man : : hoof — ^leg dog horse boy shoe 

1.51 complex — simple : : hard— brittle money ecisy work 

1.51 frame — picture :: lake — porch photo window iskmd 

24 1.48 sweet — sugar :: sour — sweet bread man vinegar 

1.47 a— b : : c— e d b letter 

1.46 left — right : : west — south direction east north 

1.46 granary — ^wheat : : library— desk books paper librarian 

1.46 dog — bark : : cat — fur chase mew mouse 

1.44 palace — ^king : : hut — peasant barn farm city 



35 

23.... 1.43 man — woman :: brother— daughter sister boy mother son 

1.43 door — ^house : : gate— chimney yard swing window 

1.41 hope — happiness :: despair — grave repair death grief 

1.41 sit— chair :: sleep— ^^J rest wake snore 

1.38 winter — summer : : cold — freeze warm wet January 

22 1.37 blonde — brunette :: light — ^heavy electricity dark girl 

U5 esteem — friends :: despise — enemies forsake detest people 

1.35 Yes — No : : affirmative — win debate deny negative 

1.35 cellar — attic :: bottom — well tub top house 

U5 birth^Kieath : : planting — com spring harvest wheat 

1.34 telephone — ^hear :: spyglass — shout telegraph distance see 

1.34 angels — ^heaven :: men — earth women boys paradise 

U4 engineer — engine : : driver — horse harness passenger man 

1.32 polite — impolite : : pleasant — disagreeable agreeable man 

face 

1.32 prince — ^princess :: king — palace queen president kingdom 

1.32 wool — sheep : : feathers — pillow rabbit bird goat bed 

21 1.30 egg — bird : : seed — crack jflant grow nest 

1.30 skin — body :: bark — tree dog bite leaf 

1.26 clock — ^time : : thermometer — watch warm bulb mercury 
temperature 

2-0 

1.25 skating — winter :: swimming— diving floating hole summer 

1.22 hour — minute : : minute — ^man week second short 

122 Washington — Adams : : first— contrast best second last 

20 1.20 cannon — rifle :: big — small bullet gun army 

1.20 parents^ommand : : children— order shall obey must 

1.16 giant — dwarf : : large— dog monster queen small 

1.16 1—2 : : 3— 4 2 6 9 

19.... 1.1 4 man — ^home :: bird — nest fly insect free 

1.14 corn — horse :: bread — daily flour man butter 

1.14 wool — sheep : : fur — cat bird hat coat 

1.11 good — bad :: sweet — taste conduct sour polite 

1.11 roof — house :: hat — shoe straw attic head 

1.11 go— come :: sell — leave buy money paper 

18 1.09 roof— house :: hat— button shoe straw head 

1.09 wrist — cuff :: neck— leg giraffe foot collar 
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17.... 1.07 suitcase — clothing :: purse — ^purchase money string stolen 
1.07 ^Washington — ^Adams :: first — last worst second best 
1.07 able — ^unable : : strong— muscle exercise axe weak 
1.00 sailor — navy :: soldier — gun cap hill army 
1.00 pitcher— milk : : yzst—fiowers pitcher table pottery 
1.00 white — ^black :: good — mother time clothes bad 

16.... 0.98 uncle — ^nephew :: aunt — niece brother sister cousin 

0.96 December — Christmas :: November — ^month Thanksgiving 

December early 
0.98 terrier— dog : : Jersey— city cow horse state 
0.98 straw — hat : : leather — feather cool soft shoe 
0.94 airplane — air :: submarine— dive engine ship water 
0.94 dog — puppy : : cat — tiger dog horse kitten 

15 0.90 ^locomotive — train :: horse — station hut baggage buggy 

0.90 dress — ^woman :: feathers — neck feet bill bird 
0.90 food — ^man :: gasoline — gas oil automobile spark 

2.0 

14 0.86 above — below :: top — spin bottom surface slide 

0.86 table — ^wood : : stove — bottle paper iron cork 

0.86 skirts — girl : : trousers — hat vest boy coat 

13.... 0.82 abide— depart :: stay— over home play leave 

0.77 locomotive — coal : : automobile — motorcycle smoke wheels 
gasoUne bum 

0.77 theatre — ^people : : hive — ^thrive sting bees thick 

12.... 0.73 shoe — foot :: hat— coat nose head collar 

11. ...0.66 handle — hammer :: knob— key door shut room 
9.... 0.59 doctor — patient :: lawyer — ^nurse hospital court client 
0.59 gun— shoot : : knife — run cut hat bird 

1.0 

6 0.40 cradle — baby : : stable — horse man dog cat 

* Used as samples in the instructions to subjects. 
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L. M. GiLBRETH. The Psychology of Management. Sturgis and Walton 
Company, New York, 1918, p. 344. 

Any writer who claims that his book "will aid the cause of Indus- 
trial Peace," deserves a hearing at the present, when the whole world 
is afflicted with strikes and internal conflicts. Such a claim is made 
by L. M. Gilbreth, the author of The Psychology of Management 

This book was first published in 1914, reprinted two years ago with- 
out any revisions. Nevertheless the book still retains some peculiar 
features which characterize no other psychological work. They do not 
perhaps constitute any contribution to academic psychology, but they 
are entirely in harmony with the psychology of common sense and of 
everyday life. We refer to the various terms the author uses and the 
way in which he defines them. In no case has he attempted a new 
definition; but he has left no important terms undefined. Whenever 
possible, a dictionary meaning is given. 

The presentation of the subject matter is deductive and very clear. 
This procedure has at least one distinct value: it considers popular 
conceptions as they are rather than as what they should be; hence the 
conclusions derived from his statements are applicable to practical 
business management, in so far as they are correct. 

The whole book is divided into ten chapters. Each chapter, with 
the exception of the first one, considers an important topic, such as 
Standardization or Functionalization. Considerable space is given to 
the exposition and interpretation of Taylor's system of scientific man- 
agement. Its development is traced through various stages. It is only 
in Chapter 2, under the heading of " Individuality," Chapter 9, under 
"Incentives," and Chapter 10, under "Welfare," that we find some 
psychological discussions. Even here the topics could be brought 
much more up to date. The term "instinct," which is so much in 
vogue now-a-days in the literature on social psychology, finds no con- 
sideration in this book, although it is mentioned here and there. One 
wonders how workers can be educated to the point "where they wfll 
be fitted to work and to live " and how " the cause of industrial peace " 
can be attained without at least a preliminary study of the fundamental 
human instincts. 

The author, however, is not to be held responsible for this serious 
omission. His work is typical of its time and serves to illustrate the 
infantile stage of psychology as a science at the time of his writing. 
While he "aims at no exhaustive study of psychology" in relation to 
industry, his book may be considered a valuable contribution to this 
particular field. c. u. 

W. B. PnxsBURY. Psychology of Nationality and Internationalism. 
D. Applcton and Co., N. Y., 1919, p. 314. 
The author here presents a keen analysis of the criteria of nation- 
ality, and their practical bearing on the problems of free nations. 
While the Versailles treaty provides that henceforth each nation may 
be self-determining, there appears to be no agreement as to what con- 
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stitutes a nation. Before any national criteria can be evaluated, a 
distinction must be made between the concepts Nation and State, 
These expressions are commonly employed indifferently in reference to 
one or the other. "Nationality is the mental state or community in 
behavior," while the state "is merely the system of government, a 
unity for the sake of making and enforcing laws." 

Upon such a premise, our author finds that the language criterion 
of nationality has no claim for consideration aside from what it con- 
tributes to individual expediency in becoming naturalized. Compared 
with the instinctive and emotional basis, which appear to offer the 
fundamental sources for nationality, language, race, history, and place 
of birth are relatively unimportant considerations. At most these must 
be regarded as secondary criteria, for they refer to nationality on a 
small scale. Nationality as it exists today, transcends all the charac- 
teristics which may properly enough belong to family and tribal organ- 
izations, even though such groupings appear before the nation as such. 
The popular genetic conception of nationality in respect to the family 
or tribe is no longer satisfactory. 

A nation is a psychological unit, based upon certain priniary in- 
stinctive tendencies found among all peoples. Upon these instincts 
acceptable ideals are evolved, pretty much as social and economic situ- 
ations approve. Relativity is the big word in respect to both instincts 
and ideals. The chief instincts here involved are gregariousness, sym- 
pathy, respect for the opinions of others, taking on the nature of fear 
and hate. It would appear that fear alone is the chief generator of 
the countless ideals which complete the requisites for communal and 
national life in the psychological sense. While national ideals repre- 
sent a gradual accumulation in most cases, they may be rapidly fos- 
tered through education. Herein lies our optimism for the- future. 
Liberty and freedom have been the prevailing national ideals, except 
in the case of Germany; here the ideal was a super-personal state — 
the surrender of the individual to a mythical and unerring entity from 
which there could be no appeal. Whatever the national ideal may be, 
it, and the propensity of each individual to follow the same, constitute 
the two big factors in the consciousness of nationality. 

An important question before the world today is whether or not 
nationality is the last word in political organization. Our author finds 
every psychological reason to believe that the final step in the federa- 
tion of the nations of the world can and must be made. Were the 
problems of nationality confined to instinct alone, each nation as it 
exists would represent a closed unit. Happily the ideals which may 
be created from time to time point to the solution. These, when well 
established, have the force of instinct which insures unity and progress.. 
"One may confidently assert that the development of the national 
spirit has come about by restriction of the natural range of the social 
instincts by training rather than by any unnatural extension of them." 

Aside from the main thesis above stated, the book is replete with 
valuable suggestions of psychological and practical significance. For 
many people it must seem that race hatred is the ultimate cause of 
war, since it is regarded as a more primitive instinct than sympathy. 
Such a notion is denied by the author. Hate, while in itself is one of 
the strongest social forces operative at the present time, really devel- 
oped in the interest of group survival, having sympathy as the ultimate 
impulse. There are therefore certain ambivalent tendencies in the in- 
dividual and social minds which must not be overlooked. Again it is 
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popularly supposed that morality in general seems to be weak among 
the children of foreign bom parents, since they deplore the language, 
customs and admonitions of their parents. Yet when the situation is 
analyzed such tendencies make for American citizenship, even though 
something is temporarily lost to domestic felicity. From the view- 
point of emotional life we may judge therefore how far and in what 
direction democracy in America is doing its work. If we can keep 
our customs intact and appreciate adherence thereto, the alien alone 
will meet the fundamental requirements of citizenship. 

The book as a whole exemplifies the tendency among modem psy- 
chologists to take a synthetic view of psychology. Both the emotions 
and intellect are here treated in their adequate relations.. While it is 
not a war book in the popular meaning, it is none the less one of the 
best of them, for the author has considered the nations at war as his 
laboratory. The book requires careful study and should be read by 
everyone interested in the psychology of war and the issues that have 
grown out of it. 

University of Vermont j. w. sprowls. 

NoRAH H. March. Towards Racial Health, E. P. Dutton and Co., 
New York, 1919, p. 320. 

Miss March's book is evidently designed to serve a double purpose, — 
to give an insight into the sexual life of the child and to present a 
practical and efficient plan of sexual education for the use of parents 
and teachers. Incidentally, its chapters include many notes on sex 
hygiene which should be invaluable for the guidance of the mother in 
the care of her children. 

The volume is divided into the following chapters: The Physical 
Development of the Child; The Mental and Emotional Development 
of the Child; Care of Children; Supervision — Psychological Aspect; 
Nature Study in the Service of Sex Instruction ; Further Aids Toward 
Understanding the Biology of Sex; Ethical Training; Education for 
Parenthood; Education for Parenthood — Some Suggestions; Social 
Safeguarding. 

There are very many commendable features in Miss March's treat- 
ment of her subject. She shows a thorough knowledge of the physi- 
ology of sex, and is able to put her information into surprisingly non- 
technical terminology, although including such complicated processes 
as hormone action in her discussion. Her pssrchological deductions 
follow very closely those of G. Stanley Hall, as she indicates in her 
preface that they may do. She has dwelt very lightly on the patho- 
logical side of the sex life, which is probably quite as well, since that 
has been sufficiently emphasized of late by a number of specialists, so 
that we have almost come to forget the normal aspects of the problem. 

To the student of psychology, Miss March's book offers no new 
information. But she has deliberately chosen to write an extensive 
rather than intensive study. Since her book is intended for an emi- 
nently practical purpose, this choice is justified. It is quite as neces- 
sary that the results of our scientific research be put into simple and 
comprehensive statements from time to time as that our investigations 
be continued. Only by such non-technical summaries can the results 
of research be made available for general use. 

There is no doubt that Miss March has succeeded very ably in her 
task of popularization of sex physiology and psychology, and her book 
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is to be recommended to parents and teachers both because of its 
clarity of expression and its frank and healthy attitude toward the 
subject with which it deals. Phyllis blanch ard. 

Andr£ Tridon. Psychoanalysis, Its History, Theory and Practice. B. 
W. Huebsch, New York, 1919, p. 272. 

Tridon's book is really a masterly and comprehensive survey of the 
work thus far accomplished in psychoanalysis. It is written with clear, 
synthetic grasp, and keen insight into the problems presented by con- 
flicting theories. The scope of the work is indicated by the chapter 
headings: The History of Psychoanalytic Research; The Unconscious 
and the Urges ; The Repression of the Urges ; Night Dreams and Day 
Dreams; Symbols, the Language of the Dream; The Dreams of the 
Human Race; The Psychology of Everyday Actions; Feminism and 
Radicalism; The Psychology of Wit; The Artistic Temperament; 
The Urges and Literature; The Urges and the Arts; Forms of Ab- 
normal Compensation; The Oedipus Complex; The Neuroses. Epilep- 
sies and Psychoses; Perversions; Crime and Punishment; The Psy- 
choanalytic Treatment; The Transference; Re-education and Prophy- 
laxis; The New Ethics. 

Although Tridon lays no claim to attempting anything more than a 
summary of the contributions of the various schools to psychoanalysis, 
as a matter of fact he does far more than that. With impartial sure- 
ness, he anal3rzes and evaluates and places in proper perspective the 
work of Freud and his followers, of Adler, of Jung and the Zurich 
school, of Kempf, et als. Not that he consciously sets out to do this, 
but his treatment of the various subjects mentioned in his chapter 
headings incidentally involves such an evaluation. For example, he 
sees the " ego urge " of Adler and the " sexual urge " of Freud not 
as separate, all-important " urges " back of human behavior, but rather 
in their reciprocal relationship. 

"We must bear in mind," he says, "that the three main urges, like 
all human phenomena, are closely related and can never be considered 
as absolute entities. Sucking the mother's nipple, which in the infant 
is primarily an activity to secure food, develops into a semi-sexual 
activity totally unrelated to nutrition and from which kissing originates. 
The physical pleasure a Don Juan derives from a new conquest in- 
creases his egotism and his sense of power; and reciprocally, Don 
Juan's newly acquired sense of power and increased egotism, revealed 
by certain attitudes, postures, buoyancy, mental and physical, may in- 
crease his sexual pleasures by vouchsafing him new conquests, etc." 
(p. 28.) 

Of course, some of Tridon's chapters show a broader orientation 
and a more correct evaluation of the material than others. The sec- 
tion on repression of the urges, for instance, would be much more 
adequate were the work of Trotter (The Instincts of the Herd in 
Peace and War) and of Kempf (The Tonus of the Autonomic Seg- 
ments as Causes of Abnormal Behavior, J. Nerv. & Mcnt, Disease, 
Jan., 1920) utilized in the explanation. It is quite true that the urges 
are often denied expression by the realities of the environment. It is 
equally true, as Trotter has pointed out, that a great many repressions 
are due to the desire to follow the leadership of the herd, and are only 
explicable as the inhibition of other "urges" (to use the author's 
term), by the gregarious impulse. Kempf expresses this very plainly 
when he writes* 



Digitized by 



Google 



278 BOOK REVIEWS 

" A most important factor begins to exert pressure upon the infant 
at birth and continues throughout its life. It is the incessant, con- 
tinuous pressure of the herd ... to conventionalize its methods 
of acquiring the gratification of its needs." 

It may be that this view of the mechanism of repression is implied 
in Tridon's discussion, but it might well have been stated more clearly 
and unmistakably. 

Most of the subjects are very ably handled, however. It may be 
that the author lays somewhat more stress upon the Adlerian theory 
than upon that of Freud, but it is an open question whether the facts 
at hand do not justify such an emphasis. The occasional original 
interpolations are so penetrating and show so much discernment that 
the reader cannot but wish that Tridon had indulged in more of these 
side remarks and interpretations of his own. In view of the writer's 
clearness of thought, and conciseness of expression, it is hardly suffi- 
cient to classify the book merely as the one broadly synthetic work in 
the field of psychoanalysis. Even on that basis, however, it should 
prove an important addition to psychoanalytic literature. 

PHYLLIS BLANCHARD. 

Summer H. Slighter. The Turnover of Factory Labor. D. Ap- 
pleton & Co., New York, 1919, p. 460. 

Throughout his thesis the author sets forth the urgent need for 
a definite and well-defined labor policy in industry. He speaks from 
his actual experience as a worker among workmen as well as from 
an analysis of facts gathered from many channels of recent research. 

Employers do not have time for an analysis of the human ele- 
ment in the productive process from the point of view of the human 
being himself, so Slichter's problem is getting the employer to feel 
the things the worker experiences every day at his work. Many 
surprising reactions are shown which may be expected from workers 
under various conditions, under "panicky" and prosperous times. 

How a feeling of estrangement between men and management, the 
" drive " system of management, the spirit of profit making, the social 
stigma attached to certain types of work, all tend to kill interest and 
take the soul out of the worthwhile activity, are only a few of the 
many ideas clearly treated in explaining the present attitude of the 
working class. 

Following a keen analysis of the motivation of the workers* behavior, 
a constructive labor policy is outlined. The keystone of his policy is 
the Supervisor of Labor. The responsibility for handling rates of 
wages, working hours, promotions, amelioration of working conditions, 
grievances, and foreman training is concentrated in the hands of this 
executive to assure adequate attention. The type of man for this job 
is of supreme importance. " Only when the determination of the labor 
policy is placed in the hands of a Specialist in labor problems will the 
problem ... be solved." 

The extensive field which the material and references cover makes 
this a work on labor problems. Superintendents, employment man- 
agers, foremen, social workers and students of social psychology will 
find the book full of vital information in regard to the motivation of 
the individuals who daily pass in and out of the employment gate of 
a large factory. 

Carnegie Institute of Technology, Pittsburgh, Pa. myron f. barrett. 
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Herbert Woodrow. Brightness and Dullness in Children. J. B. Lip- 
pincott Company, Philadelphia, 1919, pp. 322. 

The author calls this book an introduction to the science of general 
intelligence, and rightly so, for his language is so simple and the 
presentation of facts and theories so lucid and stimulating that it 
should prove intelligible as well as interesting to the reader who has 
no previous knowledge of a general psychology. 

Without entering into a theoretical discussion of the various hypoth- 
eses concerning the nature of general intelligence, the second chapter 
takes up, in a somewhat chronological order, the various scientific 
attempts at the measurement of intelligence, admitting as the only 
valid objection to the Binet tests that "the influence of the tester's 
personality cannot be entirely eliminated " (p. 39). In the third chapter 
an important distinction is drawn between intelligence as measured by 
mental age or as an absolute amount which increases with age, and 
intelligence as " more or less constant throughout life " or as " bright- 
ness," of which idiocy and the superiority of genius represent the pos- 
sible extremes. The term is used by the author in the first sense, 
with the further qualification that " intelligence means not the capacity 
for success along any one line of endeavor, but general capacity" 
(p. 148) for success in all those tasks and performances which require 
mental activity for their execution. Nor is any one special phase of 
such activity to be identified with intelligence, as various other writers 
have attempted to do. Our author is similarly guarded in his dis- 
cussion of the intelligence quotient, which, he says, "cannot be ex- 
pected to remain constant except for the average" (p. 52). 

The topic of brain development in children is illustrated by an 
hitherto unpublished curve of Dr. Richard Scammon which he de- 
rived from a very careful study of all existing data. A short chapter 
on physical defects and their bearing on general intelligence is fol- 
lowed by a treatment of the problems of anatomical or physiological 
age in its relation to mental age which is superior to that of any other 
writer known to the reviewer. In the chapter on pedagogical age 
emphasis is laid upon the causes of and remedies for retardation in 
school. The next three chapters deal with the relation of intelligence 
to the more fundamental, simple and complex mental processes and 
capacities, leading up to the important problem of mental organization, 
the treatment of which is, unfortunately, too brief to equal other 
chapters in lucidity; yet it is along the lines here indicated that the 
author's greatest opportunity seems to lie for an important and lasting 
contribution to the science of general intelligence and to psychology. 
The chapter on heredity, with its illustrative case studies, prepares the 
way for the discussion of the problems and methods of special instruc- 
tion of dull, feeble-minded, and superior children. 

The most valuable feature of the book as a whole is the successful 
combination of scientific accuracy with simplicity of style and con- 
creteness of subject-matter. The latter has been enhanced by well- 
selected illustrations, among which are two full-page radiographs 
showing carpal development at varying anatomical ages. l. r. g. 

Ransom A. Mackie. Education During Adolescence. E. P. Dutton 

and Company, New York, 1920, pp. 222. 

This book is intended as a general introduction to the principles of 

secondary education and is admittedly based very largely upon G. 

Stanley Hall's works on " Adolescence " and " Educational Problems." 



Digitized by 



Google 



280 BOOK REVIEWS 

President Hall has contributed a short Introduction to the book of 
his former student. The first chapter, entitled " Education During 
Adolescence,'' is a resume of Hall's general ideas on the subject, to 
which the author adds by way of "comment" four specific aims that 
high schools should pursue, relating to physical well-being, vocational 
guidance, personal culture, and social efficiency. The second chapter 
deals with the six-year high school curriculum, the third with prin- 
ciples of election. Here many opinions are quoted, almost at random, 
ending with the author's own opinion. The heading of the fourth 
chapter is more promising : " Changes Proposed in Secondary Educa- 
tion," but after a few more citations and some vague references to the 
Boston and Seattle schools we arrive at such generalities as this: 
" In order to be self-supporting, each individual should take studies 
bearing directly or indirectly on some trade, occupation, or profession. 
♦ ♦ ♦ But he should be trained for genuine citizenship. * ♦ ♦ 
and ♦ ♦ ♦ he should secure 'general culture'" (p. TJ), The re- 
maining three chapters deal with the " Required Subjects," namely, 
Social Studies, English, and History, and consist almost entirely of 
loosely connected quotations from Hall, Elliott, and reports of com- 
mittees of the National Education Association. With the present 
shortage of labor and material, this kind of literary hero-worship is 
greatly to be deplored, even if it were accompanied by valuable original 
offerings, as is not the case in the book before us. l. r. g. 

W. J. Crawford. Experiments in Psychical Science. E. P. Button 
and Company, New York, 1919, p. 201, 

The author of this volume is a Lecturer in Mechanical Engineering 
at the Municipal Technical Institute and at Queen's University, Bel- 
fast. The present book is in part a continuation of his previous work 
on The Reality of Psychic Phenomena, The author describes in some 
detail his methods and the results obtained with levitation, contact 
phenomena, and direct voice phenomena. He gives minute descriptions 
and measurements of all conditions, utensils, and other items involved; 
for instance, the weight of the medium before and after the seance, 
the weight of the levitating table as well as its dimensions, and even 
its temperature during a long levitation. He illustrates his explana- 
tions with many figures and drawings and four full-page photographs. 
On the basis of answers received from the " spirit operators " to ques- 
tions about their methods of producing their psychic phenomena the 
author attempts to construct several hypotheses purporting to explain 
these phenomena analogous to the laws of mechanics. He be- 
lieves, for instance, that "a psychic structure" emanates from the 
body of the medium built up of organic matter in a very unstable state 
and acutely sensitive to practically all light, and exclaims : ** Imagine 
then the devastating effect of the magnesium flash upon this delicate 
structure." Nevertheless this same psychic structure in other respects 
obeys the laws of mechanics. The experiments with voice phenomena 
were practically without positive results. In spite of all pseudo-scien- 
tific efforts to introduce a few physical measurements into the seances 
the author does not seem to have been able to avoid self-deception, and 
his experiments are not convincing. l. r. g. 
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Walter Scott Monroe. Measuring the Results of Teaching. Hough- 
ton MifBin Company, Boston, 1918, pp. 297. 
This book, which is intended for the teacher in the elementary 
school, describes a number of standardized educational tests in each 
of the following subjects: reading, arithmetic, spelling, handwriting, 
language and granmiar, geography, and history. The emphasis is not 
laid upon detailed directions for giving the tests, but on the problems 
of interpreting results and scores obtamed by them, since the teacher 
is not to use tests as ends in themselves, but as means to improving 
her methods of teaching. The tests are to furnish objective standards 
to be attained in the classroom by pointing out where over-emphasis 
must be avoided and where more emphasis is required. The intro- 
ductory chapter demonstrates the inaccuracy of the prevailing mark- 
ing system and states the advantages of objective methods of measur- 
ing the results of teaching. At the end of each chapter a number of 
stimulating questions and topics for further study are given. Many 
illustrations and tabulated results serve to make the discussions as 
concrete and helpful as possible. A valuable appendix gives detailed 
directions for ordering the right kind and amotmt of printed blanks 
and other test-material, with prices and sources. Everything is done 
to make the book practical and helpful to the elementary teacher. 

u R. G. 
Lewis M. Terman. Condensed Guide for the Stanford Revision of 
the Binet'Simon Intelligence Tests, Houghton Mifflin Company, 
Boston, 1920, pp. 32. 
This "Guide" is based on Terman's Measurement of Intelligence 
and ''a similar guide [that] had been prepared in the Office of the 
Surgeon-General for use in the army" with the assistance of Dr. J. 
W. Bridges and Major H. C. Bingham. In the "General Directions" 
certain injunctions are re-emphasized in the form of "ten command- 
ments," amongst which the warning against "wholesale coaxing and 
cross-questioning" is especially urgent, as perhaps most frequently 
sinned against, particularly by teachers. In place of the "Record 
Booklet " there is now issued an " Abbreviated Filing Record Card " 
of 8^x11 inches, which will prove much more convenient and less 
cumbersome than the Booklet. It seems almost unnecessary to add 
that neither the Condensed Guide nor the Abbreviated Filing Record 
Card should be used by the novice in mental testing. l. R. c. 

The following publications have been received r^ 

Phylus Blanchard. The Adolescent Girl, Moffat, Yard and Com- 
pany, New York, 1920, pp. 242. 

June E. Downey. Graphology and the Psychology of Handwriting, 
Educ. Psychol. Monographs No. 24. Warwick & York, Baltimore, 
1919, pp. 142. 

Harold O. Rugg and John R. Clark. Fundamentals of High School 
Mathematics, World Book Co., Chicago, 1919, pp. 368. 

Daniel Starch. Educational Psychology, The MacMillan Company, 
New York, 1919, pp. 473. 

Edward K. Strong, Jr. Introductory Psychology for Teachers, War- 
wick and York, Baltimore, 1920, pp. 233. 

M. R. Trabue and F. P. Stockbridge. Measure Your Mind, Double- 
day, Page and Company, New York, 1920, pp. 349. 

1 Mention here does not preclude further comment. 



Digitized by 



Google 



282 BOOK REVIEWS 

James R. Angell. The Organisation of Research, Reprinted from 
The Journal of Proceedings and Addresses of the Association of 
American Universities, 21st Annual Conference, November, 1919, 
pp. 27-41. 

W. V. Bingham. The Division of Anthropology and Psychology of 
the National Research Council. Reprinted from Science, N. S. 
Vol. LI, April 9, 1920, pp. 353-357. 

Frank G. Bruner. Sixty-fourth Annual Report of the Board of 
Education, Chicago, for the year ending June 30, 1918, pp. 49-111. 

Lotus D. Coffman. Teacher Training Departments in Minnesota 
High Schools, General Education Board, 1920, pp. 92. 

HoNORio F. Delgado. La Psicologia de la Locura, Reprinted from 
El Sigh Medico, Madrid, 1919, pp. 20. 

. El Psicoanalysis, Lima, 1919, pp. 58. 

Edward A. Pace and Others. Psychological Studies from the Catho- 
lic University of America, Psychological Monograph, Vol. xxvii, 
Nos. 118-122, 1919, pp. 515. 

J. E. Wallace Walun. The Field of the Clinical Psychologist and 
the Kind of Training Needed by the Psychological Examiner^ 
Reprinted from School and Society, Vol. ix, No. 225, April 19, 

1919, pp. 463-470. 

. The Achievement of Mental Defectives in Standard- 
ised EducationcU Tests, Reprinted from School and Society, Vol. 
X, No. 244, Aug. 29, 1919, pp. 250-256. 

The Educational Record. Vol. 1, January, 1920. Editor: Samuel 
Paul Capen. Published by the American Council on Education, 
Washington. 

Journal of Educational Research. Vol. 1, No. 1, January, 1920. 
Editor: B. R. Buckingham, Univ. of Illinois. Published at Me- 
nasha, Wis., monthly, except July and August 

Phiuppine Journal of Education. Vol. 1, No. 7, April, 1919. Edi- 
tor: Augustine S. Alonzo. Published by the College of Education, 
University of the Philippines, Manila. Monthly, except May and 
June. 

Wisconsin's Educational Horizon. Vol. 2, Nos. 4-5, March-May, 

1920. Editor: Edward A. Fitzpatrick. Issued bi-monthly by the 
Wisconsin State Board of Education, Madison, Wis. 

Report of the Surgeon-General, U. S. Army, in 2 volumes, 1919. 
Government Printing Office, Washington. 

War Department: Bulletin No. 11, March, 1919. Containing: 
Physical Examination of the First Million Draft Recruits: Meth- 
ods and Results, Compiled under direction of the Surgeon-Gen- 
eral, M. W. Ireland, by Albert G. Love and Charles B. Davenport 
Same authors prepared: Defects Found in Drafted Men, 66th 
Congress, 1st Session, Senate Committee Print, 1919. 
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EQUALITY IN DIFFICULTY OF ALTERNATIVE IN- 
TELLIGENCE EXAMINATIONS. 



By Edward L. Thchindike, Teachers' College, Columbia University 



In investigations made to secure equal difficulty in the al- 
ternative forms of the Intelligence Examination arranged by 
the writer for use by Columbia Collie and other institutions, 
certain facts of general interest have been found, which I report 
at this time. 

One .element of the examination is a 12 page team of 13 
tests, containing 144 tasks in all. There are 15 forms of 
this. They were made somewhat hastily from the harder 
tasks of some of the Army Alpha tests, and other tests known 
to correlate well with intelligence, extended by similar tasks 
improvised by Dr. A. L. Rogers, Dr A. I. Gates, the writer^ 
and others. No great care was given to making the 15 cor- 
responding tasks, or even the .15 corresponding tests, equal 
in difficulty. Only that was done that could be done by 
common-sense measures without using up much time or 
money in experimentation. There was in fact no time avail-* 
able in the case of the original use of these tests (the selection 
of officer material in the Air Service of the United States 
Army.) The d^ree to which the 15 forms are equal in diffi- 
culty thus measures the result that jmay be expected in 15 
forms of a 30-minute examination of 144 items, arranged with 
common-sense precautions. 

Ten of the fifteen forms are nearly enough equal for any 
purpose to which such examinations are likely to be put. A, 
E, J, L and N are approximately equal ; C and I are about 1% 
easier; F, K, and M are about 1% harder; H is about 3% 
easier; D about 5% easier; G and O are about 2j4% harder; B 
is about 5% harder. These estimates may be in error in re- 
spect to single forms, but the general drift is substantially cor- 
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rcct. One of the quickest, and probably one of the cheapest, 
ways to get any given number of alternative examinations of 
approximately equal difiiculty, is to make about 1^ times as 
many as will be needed, as nearly equal as common-sense 
procedures can make them, test all, and retain those which arc 
up to specifications. The equality thus secured is a genuine 
equality of the different forms as they are actually used. 

For most uses of these examinations only one of tiie fifteen 
need be discarded, since it is wise in general to use two forms 
together to make one hour of this sort of work. Seven such 
pairs differing as pairs by only 1% in difficulty can be had. 
These seven sets of two each thus furnish a convenient in- 
strument for rq>eated measurements of the same individuals, 
or for the comparison of groups where there is danger that 
there may be gossip concerning tiie examination. The error 
of the instrument is inappreciable in comparison with the 
chance variation of individuals. 

The evidence for the above conclusions is as follows : — 
The material for measuring the differences in difficulty of 
the various forms consists chiefly of four sorts: (a) records 
of over 800 individuals taking two or three forms in succes- 
sion without any fore-exercise; (b) records of over 500 in- 
dividuals taking two or three forms in succession after fore- 
exercise; (c) records of about forty individuals each of whom 
did all fifteen of the forms, in the order A, B, C, D . . . . O. 
First let us get certain very reliable differences estimated. 
Forms A and J being taken in that order, the median difference 
is J-A = 12 ± 0.7 for 154 college students. Forms A and F 
being taken in that order, the median difference is 
F-A = 10 0.7 for 160 college students. So J-F = 2 ± 1.0. 
Forms F and K being given in tiiat order, the median differ- 
ence is K-F = 2^ ±0.3 for 351 college students. Forms 
J and K being given in that order, the median difference is 
K-J = 3 ± 0.5 for 144 college students. So J + 3 = F + 2,^ 
or J-F = — 0.5 ± .06. ' G>mbining all the results 
J-F = .75 ± -75, or approximately J = F -|- 1. Forms 
B and F, and A and J, being given in those orders, the median 
difference F-B = 15 for 200 college students; the median dif- 
ference F-A = 10 for 160 college students. Hence, we have 
B + 15=;A + 9 or B = A-6. Forms A and G being given 
in that order to 113 college students, we find the median dif- 
ference to be G-A = 9. Since F-A = 10, J-A = 12, G = J-3 
or G = F-1 ; but since, in the long tun, F = J-1, we may put 
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3G = J-3+J-2 or 2G = F+l-3+F-l, whereby G = J— 2J4 
orG = F— 1>^. 

The forms Practice form, |B, and C .being given in that 
order, we have a median diflFerence C — B=:12 for 86 in- 
dividuals. The forms Practice form, B, and F being given in 
tiiat order, we have a median difference F — B = 10 for 126 
individuals. Hence C — F = 2 or F = C — 2. 

So far we have J = F+ l = G + 2>4 = C— 1, and 
B = A — 6. 

Assuming that the general practice gain from second trial 
to third trial is 3,^ we can evaluate H and K as follows : — 

In X G H, the median H — G = 9 for 113 individuals. 
H — G irrespective of position would then be 6, and 
H = G + 6. Since J = G + 2j4, J = H — 6 + 2J4. So 
H = J + 3J4. In X F K, the median K — F for 151 indi- 
viduals is 1J4. K — F irrespective of position would then be 
— V/i, and K*=F —lyi In X J K the median K — J for 
144 individuals is 3^4 . K — J irrespective of position would 
then be yi and K = J + >4. Combining the two lines of evi- 
dence on K, 2K = F + J — 1, whereby 2K = F + F + 1 — 1, 
and K = F, or 2K = J — 1+J — 1, and K = KJ — 1. 

Assuming 12 as the practice effect of second over first posi- 
tion when no fore-exercise is given, we can evaluate A. We 
have (from the sequences A F, A G ^d A J,) median differ- 
ences for 160, 113 and 156 individuals, as follows: 
F — A =; 10, G — A = 9, J — A = 12, including the practice 
effect. Excluding it, we have :F — A= — 2, G — A= — 3, 
J_A = 0. From these 3A = 3J+1 J^. 

So far we have J = F + 1 =G + 23^ =C — 1 = 

H — 33^ = K+1 = A — J4 = B + 5J^. 

Using these facts we may estimate the amount of practice 
effect to be allowed for in those who took all fifteen forms in 
the order A, B, C, . . . O. If there is no practice gain 
from F on, J-f K will equal F-|- G-f2j/^. In fact 
J-f-K = F-[-G-i- 4>^. in the group of 38 individuals who 
took all forms. There seems thus to be a gain of about j/i 
point per form due to practice at this stage. If there is no 
practice gain from C to F G, F-f-G will equal 2C — 5j4. 
In fact F -|- G = 2C + 10- So the practice seems to be -|- 7j4 
from G ;to F G, or about 2 imits per form. 

^3 is the median of 13 such cases. Alsa G and J being so taken 
by 26 individuals, the median J — G was 5. Since J = G + 2J4, the 
practice effect would be 254. 
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We may then assume that if all the forms were of a^roxi- 
mately equal difficulty, the improvement from C to O would 
be apfMx>ximately 2 2 2 \ y2 y2 % % Va % % %- The 
average scores for C, D, E, etc. for the 239 individuals tested 
were, in order, 90, 97, 93, 97, 92>^, 96>i, 99, 99, 95, 97>4, 
97,99,97. 

The amount by which each form is easier or harder than 
the average of all the forms may then be estimated approxi- 
mately as : 

C = Av+l, D = Av + 6, E = Av, F = Av + 3, 
G = Av — 21^, L = Av+j4, I = Av + 2, J = Av+l>^, 
K=Av— 3, L=Av— >4, M=Av— 2, N=Av, and 

= Av — 2. 

Using these facts to extend and amend the values already 
obtained, we have, in relation to the average : — 
A=+J4 B=— 5)4, C=+l, D=+6, E = 0, 
F=-l, G=-2J4, H = +3, I = +2, J = 0, 
K = — 1, L = — J4, M = — 2, B = 0, = — 2. 

We may now cliedc these estimates by estimates derived 
from entirely different data. 

Assuming that the practice effect of second over first posi- 
tion when fore-exerdse precedes both* is 7, we have 
G — B = 12 — practice and C — B = 10 — practice from 
126 and 86 individuals respectively. Hence B = F — 3 and 
C = B -|- 5. Since F is accurately determined as Av — 1, we 
have B = Av — 4 and C = Av + 1- 

313 individuals having Practice form, D, and E, showed a 
median E — D = 4J4. Apart from practice, then, 
E — D = — 2y2. 28 individuals having Practice form, G, 
and H, showed a median H — G = 9. Apart from practice, 
then, H = G + 2. 20 individuals Itaking O and E after fore- 
exercise, showed a median difference of E — = 10. Al- 
lowing for practice E — = 3. = E — 3. 

15 individuals did G, H, and I, five in the order G, H, I, 
five in the order H, I, G, and five in the order I, G, H. The 
median scores were 108, 115, and 110, whence H = G-|-7, 

1 = G-f2, H = I-|-5. 

27 individuals did forms F and G in that order without fore- 
exercise. The median G — F was 10. Allowing 12 for prac- 
tice, G is 2 harder than F, or G = F — 2. 7 individuals did 
forms D and J in that order, without fore-exercise. The 
median J — D was 7. Allowing 12 for practice, J is 5 harder 

* This assumption is made on the basis of the fact that, including the 
eflFcct of practice, C — B = 12 for n = 86, F — Bt=10 for n = 126, 
E — D = 4J4 for n = 313, H — G=9 for n = 28. 
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than D, or D = J -{- 5. 36 individtials did forms F and J in 
that order without fore-exercise. The median J — F was 
13 J4. Allowing 12 for practice, J = F + 1>^- 33 individuals 
did forms G and J ?n that order without fore-exercise. The 
median H — G was IS. Allowing 12 for practice, J = G + 3. 
26 individuals did forms G and J in that order as second and 
third. The median difference was J — G = 5. Allowing 3 
for practice, J — G = 2, or J = G + 2. 

28 individuals did forms J and L in that order without fore- 
exercise. The median L — J was 11. Allowing 12 for prac- 
tice L=3j — 1. 15 individuals did forms G and K in that 
order as second and third. The median difference was; 
K — G = 4. Allowing 3 for practice, K — G=l or 
K = G+ 1. 36 individuals did H L in that order as second 
and third. The median difference was L — ^H= — 1. Al- 
lowing 3 for practice, L — H= — 4 or L = H — 4. 

Similar data for the sequences K M, J M and L M give the 
following : 

n = 9, median difference M-K = 0. SoM — K= — 3; 
M = K — 3. 

n = 40, median difference M-J = 2V$. So M-J = — J4; 
M=J — y2. 

n = 28, median difference M-L = 4>^. So M-L = — 1 J4 ; 
M = L+1J4. 

Similar data for the sequences C N, K N, and L N give the 
following : 

n = 9, median difference = O. N — C = — 3. 

n = 7, median difference =6. N — K = 3. 

N = 4, median difference =1. N — L=; — 2. 

Using these facts we have the following estimates to com- 
pare with those previously obtained. 
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On the wbcrie we shall not be in serious error if we take 
A = E = J = L = N, ootmting C and I as 1 point easier, F, 
K and M as one point harder, H as 3 points easier, D as 5 
points easier, G and O as 2>4 points harder, and B as 5 points 
harder. The probable error of diese estimates ranges from 
about % to 1>4 points. 
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CORRELATION OF ARMY ALPHA INTELLIGENCE 

TEST WITH ACADEMIC GRADES IN HIGH 

SCHOOLS AND MILITARY ACADEMIES 



By H. E. BuRTT and G. F. Abps, Ohio State University 



Introduction 

Numerous studies have been made in recent years compar- 
ing mental tests, and especially intelligence tests with academic 
grades. The imderlying hope seems to be that a student with 
good mental ability or intelligence (original nature) will do 
well in school or college and receive good marks and that, 
hence, it will be possible to predict future academic status on 
the basis of tests which measure intelligence. One of the 
most notable results of practically all such studies is the low 
correlation obtained. A correlation of .50 seems to be the 
exception rather than the rule, and prediction based on a cor- 
relation much smaller than this is of doubtful value in the 
individual case. 

Tliere are at least two errors which might contribute to 
these low correlations: either the tests are not an accurate 
measure of mental ability or the school marks are not an 
accurate measure of academic ability. Either measure is of 
course vitiated if the work is not performed with maximum 
incentive. It is probable that most pupils work with a fair 
approach to their maximum ability in taking mental tests. 
The test is usually brief and does not reach the point of pro- 
ducing " annoyingness " as is often done by school work. 
Furthermore the pupil being unaware of the real purpose of 
the tests assumes that a good deal is at stake and, consequently^ 
does his best. It is probable on the other hand that many 
students do not work with maximum incentive in their studies 
or do not devote to them sufficient time to manifest their maxi- 
mum ability. Any teacher would heartily endorse this state- 
ment. The writers feel that this latter alternative is a possi- 
ble explanation of the low correlations generally found be- 
tween intelligence tests and academic status. Suggesticms of 
this sort have been made before.* It would seem further that 
certain types of instruction hold students more closely than 

1 Anderson, J. E., Intelligence Tests of Yale Freshmen, School and 
Society, Vol. XI, 417^20. 

289 



Digitized by 



Google 



290 BURTT AND ARPS 

Other types to their maximum intellectual ability. One of the 
writers found a noticeably closer relation between the adult 
"point scale" (Yerkes) and grades of students in a psycho- 
k^ course which had frequent and vigorous written exam- 
inations than between point scale and total academic marics 
for a similar group.* 

During the summer of 1918 one of the writers was in charge 
of the mental examination of a group of R. O. T. C. men at 
Camp Custer, Michigan. Most of the members of the group 
were at the time in the midst of their course in high sdioob 
or military academies. These two types of institution differ 
considerably in methods of instruction especially with respect 
to supervision of study, general supervision of pupils and sys- 
tems of demerit (punishment). It seemed possible by com- 
paring the intelligence tests and academic marks for those 
groups to determine whether tiie methods of instructicMi do 
differ in the extent to which they elicit maximum intellectual 
performance in school. 

Method 

Academic marks prior to army service were obtained from 
the heads of schools and academies which these R. O. T. C. 
men had prcviouslv attended. The information was obtained 
on a blank calling for die average mark of a student in science, 
mathematics, languages (including English), history and 
"other subjects" and also the number of courses of each 
sort that were taken. Most of the marks obtained were in 
numerical form so that statistical treatment was possible. It 
was an easy matter to obtain a single average for total 
academic work by weighting each branch of study in propor- 
tion to the number of courses taken in that branch. 

It is obvious that marks obtained from different schools 
with their different standards of marking could not be validly 
grouped together in crude form to obtain a correlation coeffi- 
cient. Even if the marks were thrown in to terms of average 
or passing mark there would still be a source of error in the 
scatter for different schools. Consequently, each school or 
academy was taken separately and the mean and standard 
deviation obtained for total academic marks of the R. O. T. 
C. men of that school and the mean and standard deviation 
found also for the various school branches for those same 
men. Each individual mark was then put in the form of X 

2 Yerkes, R. M. and Burtt, H. E. The Relation of Point Scale 
Measurements of Intelligence to Educational Performance in College 
Students. School and Society, Vol. V, 535-540. 
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divided by standard deviation where X is deviation from the 
mean. Thus a student with a score of -j; 1-5 in school A is 
of the same academic ability as a student with a score oi -{-1.5 
in school B, although the passing mark and rthe scatter of the 
students in the two schools are entirely different. The score 
simply indicates what proportion of the standard deviation 
for this school the person is above or below the average for 
this school. Scores of this sort were then available for all 
the features of interest, and it was valid to include all the 
military students in one grotq> and the high school students 
in another. No school was included from which there were 
fewer than ten R. O. T. C. men. These scores were then 
plotted against the Army Alpha Intelligence Test and the cor- 
relation computed by the products — ^moments method. 

Results 
The correlations are based on 118 men in five military 
academies and 93 men in eight high schools. The groups 
themselves are very similar in intelligence as shown by the 
test. The military academy group has a mean score of 129 
and a standard deviation of 25.6, while the high school gmup 
has a mean score of 130 and a standard deviation of 25.8. 
The principal interest lies in the comparative correlations for 
the two groups. These are given in the tables. 

TABLE I 



Correlation Alpha 
Total With: 



Military 
Academies 



High 
Schools 



Academic total. 
Mathematics. . . 

Science 

Language 

History 



.32 
.47 
.42 
.40 



.19 
.16 
.18 
.22 
.25 



P. E. (Approximate) . 



.05 



.07 



Correlation Academic 
Total With: 



TABLE II 

Military High 

Academies Schools 



Testl. 
Test 2. 
Tests. 
Test 4. 
Test 5. 
Teste. 
Test 7. 
Tests. 



.41 
.36 
.19 
.41 
.32 
.25 
.45 
.25 



.06 
.14 
.27 
.27 
.26 
.16 
.18 
.37 



P. E. (Approximate) . 



.06 



.08 
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TaWe 1 gives the correlation of the total Alpha score, that 
is the general intelligence rating, with the total academic marks 
and also with marks in several school branches. The cor- 
relations are of about the same order that is usually found 
in similar studies. The most noticeable thing in the table is 
the correlation of intelligence and total academic ability of .39 
for the military group as contrasted with .19 for the high 
school group. This is a most significant result of the study. 
The writers feel that it indicates a superiority of methods of 
instruction in military academies from the stand point of hold- 
ing the students to their maximum mental efficiency. This 
result does not seem to be due primarily to any single scho<^ 
subject. The diflference between the correlation for the two 
groups holds rather consistentiy with various school subjects 
as indicated in the other figures of the table. ' The difference 
seems to be slightly greater with science and slightly less with 
history but it is very doubtful if this fact is of significance. 
It is impossible that the discrepancy between the two groups 
could be due to a greater homogeneity of the high school 
group in intelligence because the standard deviations show 
that the distribution curves of the two groups are practically 
identical. 

Table 2 gives the correlation of total academic marks with 
the eight different tests of the Alpha Examination. This 
table is not as significant as the first. There are two tests, 3 
(practical judgment) and 8 (information) in which the cor- 
relations are slightiy higher for the high school group but 
the differences are not significant when the P.E. is considered. 
The greatest discrepancies in the other direction are in test I 
(directions) and test 7 (analogies). This would suggest that 
tiiese latter tests are somewhat more indicative of the instruc- 
tion differential between the two types of schocri. 

It seemed worth while to investigate the linearity of the 
regression in the case of the two principal correlations of 
the sttuly. The correlation ratio (eta) was found to be .52 
for academic total on Alpha total in the military group and 
.49 in the high school. The corresponding correlation coeffi- 
cients were .39 and .19. Blakeman* suggests several formulae 
which give the ratio of the difference between eta and r, or 
of the difference between their squares to the probable error. 
His simpler formula (recommended for rough work) gives a 
value of 2.8 for the military r^ression and 3.2 for the high 

* Blakeman, J. On Tests for Linearity of Regression in Frequency 
Distributions. Biometrika, Vol. 4, 332-350. 
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school. His more exhaustive formulae, (one giving ratio of 
difference of squares to probable error and the other giving 
ratio of difference of first powers to probable error) agree 
closely in yielding values of 3.0 and 3.9 for the respective 
groups. . Blakeman considers that this value should be less 
than 2.5 (corresponding to a probability of 9 to 1) to indicate 
linearity. 

These figures indicate that for the high school regression at 
least the observed values fit some curve more closely than 
they fit a straight line. Inspection of the scatter plot suggests 
a considerable concentration in the quadrant for high intelli- 
gence and low academic grades and the possibility of the 
regression line curving somewhat in to that quadrant. Many 
of the individuals in this quadrant are doubtless those who 
have good ability but are not induced to use it in school. 
This feature is not nearly as clear in an inspection of the 
plot for military students and furthermore Blakeman's test 
shows this regression to be more nearly linear. These facts 
are a further corroboration of the main thesis of this study. 

Conclusion 

The low correlation generally found between intelligence 
tests and academic marks may be to a considerable extent due 
to the fact that methods of school instruction do not hold 
students to their maximiun efficiency. The correlation of 
Anny Alpha with academic marks in high schools and military 
academies 3rields an appreciably higher correlation for the 
latter group. This is not caused by differences in homogenity 
of the groups nor does not seem due primarily to any specisd 
school subject but to be a general characteristic throughout 
the curriculum. This suggests that methods of instruction in 
the military academy, such as general supervision, supervised 
study and a system of reward and punishment, are more apt 
to hold the student to his maximum intellectual ability. 
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SHOULD PSYCHOLOGY BAKE BREAD* 



EuoTT FiosT, Rochester, N. Y^ 



I 

Baking bread is a human task, popular rather generally, and 
over a su£Bcient number of years to give it standmg among the 
very best people. Perhaps for these several reasons we allow 
it in our thinking to typify the practical. Should psychology 
in this sense bake bread, and if so what kind of bi^ad should 
it bake? 

It is to be generally admitted that a science implies the 
observation and cc^ection of raw facts, and the correlation of 
these facts under laws. Such laws once detennined niay, if 
we so desire, then be utilized to secure ends— either theoretical 
ptuposes which shall lead us cm to additional facts ; or prac- 
tical ones which shall help us to justify our studies by enabling 
us to aid in the solution of those very human problems that 
we all, from time immemorial, have faced. 

There is no one of scientific temper, who would care to 
defend the thesis that truth is " its own excuse for being " if 
by the statement we mean that the question — "What is this 
true thing good for,'* is a wholly irrdevant one. Whatever 
our personal inclination may be as to the propriety of our 
making applications of our data once they are assembled; 
whatever our belief as to the timeliness of attempting applica- 
tion of a particular science, or of attempting it under any 
special conditicms, there is a very general admission that both 
the excuse and the incentive for research, Ues in the fact that 
the results of it may, in due and proper time and under some 
auspices, receive justification through use. Such employment 
of our results may be, and may properly be, indefinitely post- 
poned or even left for future generations to harvest in benefits, 
but in our minds there must always be implicit expectation 
that somebody sometime will somehow translate into terms 
of life those formulae which we here and now devise and 
amplify. Otherwise we are lending ourselves, our energy, and 
our training to an avocational pursuit which perhaps may be 
permitted as temporary recreation but for which we have no 

♦ Read before the local branch of the Academy of Science, Roches- 
ter, N. Y., March 1920. 
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right to receive the support and rewards of society. Thus to 
employ our entire time is to be as truly a parasite upon the 
social host as if our days were successively spent on the golf- 
course or at the chess-board. 

One of our psychologists is alleged to have said — " I should 
be just as much interested, were I a geographer, in plotting 
some insignificant South Sea Island of no consequence to 
anyone, as I would in plotting the Island of Manhattan." Such 
a statement, if true, needs interpretation. If by that he means 
that he, personally, would not be interested in accomplishing 
practical results, and seeks only for truth (which someone 
else of different temperament might subsequently apply) — 
that is cme thing. On the other-hand, if he means that he 
would willingly devote his time to the investigation of a pur- 
suit which would have and could have no advantage for 
anyone — ^that is an entirely different affair. Truth for its 
own sake is an excellent slogan as far as it goes but it never 
can or should tell the whole story. 

Let us therefore analyze our original question with care, 
distinguishing it from the entirdy different question — " Should 
Science Bake Bread ? " In the latter question we leave out of 
account the age of our particular science and its particular 
development. In short, it may well be that we subscribe fully 
to the general applicability of science and still deny categori- 
cally that psychology is ready for such application. 

II 

At least two considerations may militate against the wise 
application of a science : First, the science may be so new and 
its conclusions in consequence so half-baked, that the pre- 
mature utilization of them are of no value; or second, we 
run a liability of prejudicing the future of the science itself, 
not only in the minds of practical men but in the minds of 
our own investigators, so that their subsequent researches are 
partly, even though sub-consciously controlled, now no longer 
by a search for truth but by such biases and opinions as would 
be dictated by needs. This latter result, should it occur, would 
be not only unfortimate, but calamitous, for it would poison 
our springs at their source. 

We are now, if this be granted, in a position to clarify and 
simplify our topic although we state it at greater length : " Is 
psychology, as such, already sufficiently developed so that it 
may hope, at least in part and wisely, to offer its formulae 
and conclusions as practical recipes toward the solution of 
human problems ? " 
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It might seem, in the light of what has transpired, par- 
ticularly during the last four years, that the question is being 
asked a decade too late, were it not for the fact that a con- 
siderable number of eminent American psychologists have per- 
sistently given a negative and a priori answer to the question ; 
while many others, if of lesser note, after viewing the attempt 
of psychology to sell its services generally have been won over 
to a similar, though a posteriori, conclusion. Some in short 
have said " No, psychology should not ^empt to apply itself " 
while others have added — " Such attempts as it has made have 
not justified themselves." 

To those of you who have followed psychological discus- 
sions and psychological literature for the last fifteen years, 
from the time when Miinsterberg .railed against the application 
of psychology ; through the perickl when he wrote his numerous 
books suggesting Just such application; down to the present 
time when our psychological meetings have veritably centered 
about applied interests, it will seem that most psychologists 
have answered our query in the affirmative. Psychological 
applications to education, to medicine, to advertising, to per- 
sonnel, and to industry have of late been presented to us in 
a bewildering swarm. 

What is tihe net result first upon the object sought, and 
second upon the science which has oflFered its service? As to 
the first of these questions, namely, whether or not the results 
obtained have been satisfactory, it is the opinion of the writer 
that they have not, if we measure those results in terms of 
energ>' expended. Probably the application of psychology to 
medicine even in its indirect consequences ccwnes nearer to 
offering results of which we may be proud than does any 
other field. Even here however we have had to contend with 
psychoanalytic orgies, psychotherapeutic buncombe and a 
congeries of lesser quackeries whidi have so enveloped the 
kernel of truth contained, as to handicap and postpone the 
success that might have come from a more conservative 
investigation of the premises upon which our somewhat hasty 
conclusions have been based. 

On the other-hand, what we have failed to gain in therapeutic 
diagnoses and prognoses; in pedagogic recipes or industrial 
formulae, is made up for — and probably more than made up 
for — in other ways. We have brought the terms and the 
processes of psychology before a very wide and very important 
public. Since a few years ago when Mr. Wilson declared 
the trouble of business to be " psychological," men have ceased 
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to look sheepish when they use the term. To-day we find 
the literature of industry naturally adopting psychology as 
a necessary, explanatory science. 

Psychology suffers and always must suffer from a matter- 
of-fact point of view, by the circumstance that she is dealing 
with processes rather than masses and molecules. This aggra- 
vates the difficulty of our descriptions and explanations but 
in no way lessens the importance of them. On the contrary, 
the duty of spreading knowledge concerning hiunan instincts, 
feelings, emotions, and reactions, was never so universally 
recognized as to-day. The fields are plowed and fallowed as 
never before for every constructive suggestion that psychology 
has to offer. For this happy result the embryonic essays 
of the last decade in psychology are chiefly responsible, how- 
ever insignificant the specific success of any particular planting. 

Those who are familiar with the work of Vcblen's disciples : 
Helen Marot's " The Creative Impulse in Industry " and Ord- 
way Tead's " Instincts in Industry ;" those who have read the 
life of Carleton H. Parker or who know the work done by 
Mr. Robert M. Wolfe in his pulp and paper factories, those 
who have followed the development of Industrial Relations 
men, the Labor Manager, and the Employment Manager ; those 
who have been studying the newer ideas of plant management, 
plant sanitation, bonus and profit sharing systems, and the 
training of foremen ; those who have followed the course of 
labor adjustments in England through the Whitley reports 
and elsewhere ; and those who are familiar with the innumer- 
able, boards, bureaus, commissions, and societies designed to 
amdiorate industrialism, and put back the loyalty that comes 
from content and creative opportunity — ^to all such one need 
not emphasize that the principles of psychology are being put 
to work in industry to-day, and as a direct result, undoubtedly, 
of what psychology has done in other fields already now for 
many years. 

Quantitative changes in time always involve qualitative 
changes. In theory the ocean is but the aggregation of drops 
of brine. This ocean however knows of things of which the 
droplet never dreamed — winds and storms and waves, icebergs 
and shimmering sea, depths and foam, climate and colors and 
temperatures — all these things and many more. Just so has 
our industrial life grown from the small shop with the single 
employer and his handful of friendly assistants to a huge 
depersonalized corporation controlled by absentee capital and 
engulfing the human individual unit as one drop by the sea. 
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as to the best manufacturing practices from concerns inside 
and outside of the dty. 

The Council is operated by a Director and an Executive 
Committee, in addition [to a chairman and program committee 
of each group. During the year, with the exception of the 
summer, the groups meet bi-weekly, and are addressed by 
experts whose talks then form the basis of questions and 
discussion. So far as is known, this program is unique and 
not duplicated in any other city of the country, though many 
cities have indicated their intention of forming similar organ- 
izations. 

Out of the multitude of alleged panacea offered to the 
harrassed manufacturer to-day, one note is permanent and 
dominant: The necessity for more genuine mutual under- 
standing and a more practical co-operation. This need and 
this principle hold true, not only as between the management 
and the worker, but among manufacturers and executives in 
the interest both of themselves and the worker. In the past, 
there has been the problem of the closed shop— the shop, that 
is, closed to the rival manufacturer and often in consequence 
closed to new ideas. 

Manufacturers are now increasingly coming to feel that 
the welfare of any industry vitally depends upon the welfare 
of all industries, and that through the interchange of ideas, 
more will be gained in the long run. This would be offset 
through the temporary loss of advantage from passing along 
a good idea to one's neighbor. Upon this conviction the 
Industrial Management Coimcil is built, and in conformity 
with this thesis, it operates. 

All member concerns of the Industrial Management Coimcil 
are represented in the Rochester Chamber of Commerce which 
houses the central offices of the Council and provides a meet- 
ing place for its members. Group meetings occur on a regu- 
lar schedule throughout the year, are planned in advance, and 
are usually preceded by an informal dinner. The Chamber 
furnishes rent, heat and light ; other expenses of the Coimcil 
are defrayed by assessment upon each firm and according to 
a definite formula. Occasional group meetings of foremen, 
upwards of 1,000 at a time, are held under the auspices of 
one or more of the groups, and either foremen or workmen 
at the bench are always welcome as guests of members, since 
it is the interest of the Council to safeguard and pr<Mnote 
the success and welfare of the worker no less than that of the 
management. Some synthesis must be found as between the 
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thesis of capital and the antithesis of labor. Their goal is, 
ultimately, the same, and we can no longer aif ord to postpone 
its realization by quarreling over methods. The Industrial 
Management Council is a ^ober and honest attempt to sit at 
a common council table, to view industry as a whole, and 
thereby to come to some conclusion which shall benefit all 
partners to it. 

A second hopeful sign of our industrial times is the fuller 
recognition of the shop foremen in the industrial plant 
to-day — the recognition of the need not only for choosing the 
right kind of man but for giving him the right kind of edu- 
cation once he is found. It is coming to be increasingly true 
that the foreman marks the measure of success attained by 
the industry, and makes more than a nominal contribution to 
it. He is in a position to sell the ideas of the management to 
the employee and to sell the employee to the management. He 
is the lock in a canal. If he fails to work, there is danger 
that the waters on either side of him may grow stagnant and 
breed discontent. 

Nor are factors lacking to produce just such a situation. In 
the first place the foreman has a bad history to overcome. He 
has been treated in times past as a cog in a machine, whose 
primary duty was to get out production at any cost Physical 
prowess, a bull-dozing manner, the inspiring of fear; — these 
formerly were considered assets and men were picked as fore- 
men because of their possession of them. The modem ten- 
dency in industry to adopt methods of suasion rather than 
compulsion has left us with this body of men trained to the 
exercises of authorities which we now deny them. If our 
newer ideals are to persist, we imust either select new fore- 
men or re-educate such as we have. 

Against the effectiveness of this key-man in industry, mili- 
tates also the vivid radicalism of a relatively small group of 
agitators. These men speak with a sincerity, or an apparent 
sincerity, worthy of a better cause. If we could but grant the 
major premises, we must admire their minor premises and 
their conclusions. They use short Anglo-Saxon terms, they 
speak and write so that even the simple-minded can under- 
stand. There are said to be nearly 1,200 periodicals, regularly 
published, in this coimtry, sufficiently red of hue as to come 
under the category of * Bolshevik.' Such husky germs can 
be killed by one specific only : the truth. The foreman is the 
one man who can quickly, by word and deed, morning, noon 
and night, administer this remedy. But he must first possess 
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it. That is the responsibility of management : to give him the 
facts and keep him sold, lest, instead of becoming a doctor for 
industrial discontent, he himself catches the disease and 
spreads it. 

Every foreman can become a salesman of the management. 
Few workmen know where the contents of their pay envelope 
comes from. Few know what * overhead ' means. Few, if any, 
have an idea of the cost of doing business or the risks involved. 
Yet the average worker is interested in economic education, 
although he may not know it by that name. Part of this 
interest has been aroused by this extraordinarily clever litera- 
ture, mostly radical, which would be very important if true, 
but which is not true. If a man is told thai his employer is 
making ten or even fifty dollars a day from his labor; if he 
is told that, day after day by word of mouth and printed 
paragraphs, and no one takes the trouble to tell him it is not 
so, he is likely in time to believe it. I would and you would. 
The large employer of labor cannot go into his factory and 
chat daily with aJl of his workers. He can however give his 
policies and his ideals to the chiefs under him, and see in turn 
that they are passed down the line to and through the foreman. 
Just as the Sergeant in the Army reflects his Colonel, so does 
the foreman in the shop reflect his chief in the office. If 
management does not take the pains to instruct its foremen, 
let it not expect that these men will keep the channels open, to 
and fro, between office and bench. 

There are many present-day attempts to educate the fore- 
man by courses of intensive study and lectures, notable among 
them the work of the corporation schools of New York, the 
National City Bureau, and the National Speakers Bureau. 
Already however, these admirable educational programs have 
met with criticism. In some cases it has been felt that the 
foreman was being educated beyond his intelligence and into 
a restlessness toward, rather than a loyalty to, his job. It is 
claimed further that the teaching is valuable, as most teach- 
ing largely must be, only in the hands of excellent teachers, 
and such personnel is difficult to secure and repay. Finally 
the economic laws which govern our industrial life are operat- 
ing also here and foreman training is likely to be advocated 
in direct proportion as the supply of foremen is limited. In 
other words when labor is plentiful the average manufacturer 
will simply select the best foremen and bother himself very 
little about the remainder. 
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A third index of a fortunate industrial evolution is the 
increasingly significant role played by the departments of 
Industrial Relations, and the correspondingly larger number 
of men with special training and ability who seek them. 
Leaders in this new enterprise are receiving large salaries, and, 
speaking generally, they earn them. 

During the war, the Army and Navy each added a Morale 
Branch to its General Staff ; too tardily, it is true, to achieve 
the effective success that an earlier recognition of the principles 
would have permitted, but sufficient to sell the idea to the per- 
manent and regular establishment. Since the war, with a 
demand for production still abnormal, under-production has 
been a common lament, and is correlated with high labor 
turnover, strikes, and mental hysterias beyond precedent. 
William James long ago pointed out that none of us is 
maximumally efficient; that we possess latent sources of 
energy we seldom, if ever, tap. Added to these inefficiencies 
we now have those which come from a sullen and imwilling 
spirit, from a moral refractory period following the intensities 
of the war, and from the aggravating but separate circum- 
stance that labor and capital have lost the personal touch. 

Industrial relations are passing through a critical phase. 
Viewed by many manufacturers as a necessary sop, g^dgingly 
granted, there is a tendency to take the short, rather than 3ie 
long look, in a hopeless attempt to return to things as they 
were. On the other-hand, manufacturers with wider vision 
who are less interested in concerns of the moment and more 
interested in building for the future, contemplate this newer 
machinery which the times have set up, as an asset whose 
interest return will more than justify capital expense. If 
industrial safety, industrial housing, hiring and transfer of 
employees, training of workers, mental incentives and the 
sharing of responsibility, are looked upon as beneficences, the 
first easement of the labor market will sweep them into dis- 
card as economic irrelevancies. But the thoughtful manu- 
facturer no longer so considers them. He is willing to buy 
and pay for loyalty no less than brains and muscle ; he realizes 
that he must attract virtue no less than reward it. 

Just how many manufacturers will fall into this category 
of the ' thoughtful ' when times change, and the man seeks the 
job, rather than as at present, when the job seeks the man, it 
is difficult to predict. Until it can be established beyond per- 
adventure that it pays to educate the man into his job and in 
his job, gratuitous education is not kindly taken to. One's 
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prediction depends in part upon his interpretation of human 
nature. Either for lack of vision, or for lack of money, or 
both, most industries will probably make shift to use the 
human material that they have on hand in much the same 
condition as they find it. For those of us who are interested 
in the dissemination of education, this is discouraging but 
we must take the world as it is. It does not help much to 
criticise life. We can modify its formulae but slowly. Be- 
cause we cannot secure high-minded unselfishness on the part 
of all of our employers is no adequate ground for pessimism. 
Enlightened self-interest is quite a diflFerent affair from selfish- 
ness. If we can prove that the goal we set in our co-operative 
policies, our foremens' training, and our industrial relations, 
ministers to the good of the individual by ministering to the 
good of all, we shall have taken a step forward and up. 

Since most industrial problems are at bottom due to ignor- 
ance, they can be satisfied only by educational programs of 
some sort. There are many signs of a closer liaison between 
our universities and our industries. Several of our colleges 
and technical schools, notably the University of Cincinnati, 
have formed a close alliance with their neighboring industries, 
alike to the benefit of the factory and of the school. Some 
of our industries too, such as the Goodyear Tire Ccwnpany, 
the Ford Motor Company and others, have established imi- 
versities within their own plants, and financed them with a 
generosity which compares not unfavorably with many of our 
smaller colleges. 



Specifically, the technique of the psychological laboratory, 
is not yet suiSiciently standardized to translate it effectivdy to 
industry. Such work as that of Link is a good step forward 
but it is necessarily limited in scope. The major premise that 
the hiunan problems of industry are psychological is well 
established and curiously enough, industry and not psychology 
has been the first to recognize it. But the minor premise of 
application still is lacking and likelv to remain so until we 
develop a larger group of men whose interests and back- 
ground are both psycholc^cal and industrial. The man without 
psychological training will miss the forest for the trees; die 
man without industrial experience will see the forest but 
miss the trees. All of which is only to say that industry 
inclines to be over-practical, measuring results too objectivdy 
and quickly in profit and loss; while the laboratory psycho- 
logist leaves out of his reckoning a hundred and one variables 
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due to type of product, nationality of .worker, history of 
management, and the factors of production control, which 
vary with each industry. 

Industry to-day is needing the psychologist, certainly, or at 
least the man of psychological temper; but he must come to 
her with his overalls on ; must supplement the truth he knows 
with facts gained by .experience, and must be as eager to learn 
as to teach. 

Underdone bread is sometimes worse than no bread, and 
makes for indigestion. If the psychologist is to do any indus- 
trial baking, he must learn first to cook, for as everyone knows, 
cooking is an art and its secrets lie outside of bodes. 
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A FURTHER DEVELOPMENT OF EMPLOYMENT 
PSYCHOLOGY 



By Henry C. Link 



Aside from the mere selective and classifying value of tests 
there are connected phases of employment procedure in which 
the psychological technique may be very valuable. The 
psychologist in industry finds in his technique, an instrument 
which sometimes gives him a great advantage over the ordin- 
ary employment man when it comes to analyzing labor supply, 
adjusting rates, discovering inconsistencies in existing employ- 
ment procedure, etc., etc. 

The following study, made in an industrial concern in which 
tests were a supplementary part of the employment procedure, 
indicates several directions in which the industrial psychologist 
may look for practical results. 

During a period of six months, the psychological section of 
the personnel department had given clerical tests to 616 women 
who applied for clerical work. The method by which these 
tests were put into operation and the results followed up is 
described elsewhere. At the time when the study described 
here was made, the success of the tests had already been estab- 
lished. 

Of the 616 applicants examined — 

287 recommended by the psychological section had been 
hired; 

137 had been recommended but not hired ; 

173 had not been recommended and not hired ; 
19 had not been recommended but hired nevertheless. 

The employment office had therefore followed in the main 
the recommendations made by the psychological section. How- 
ever, the large number of applicants recommended but not 
employed, taken in conjunction with a constant shortage of 
clerks, made the following study advisable. The purposes of 
this study were: 

1. To open up new sources of clerical workers. 

2. To determine on the basis of tests which had already 
proved satisfactory, how the performance of the applicants 
examined in the emplojrment office compared with the perform- 
ance of potential candidates who had not yet applied for 
positions. 

306 
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3. To determine a basis for adjusting earning rates so as to 
make possible the selection of the most promising potential 
applicants. 

4. To point out discrepancies which were known to be 
present in the existing employment procedure. 

A series of group tests, therefore, was given to (a) the senior 
class of the commercial high school, 181 pupils ; (b) the begin- 
ners and advanced class of the X business college, 42 and 31 
pupils respectively; (c) the advanced class of the Y business 
college, 38 pupils. The principals of these schools readily 
fell in with the plan of the study when its purpose was ex- 
plained to them. The tests given were: (1) Woodworth 
Wells number group checking test ; (2) a simple addition and 
subtraction test; (3) directions test; (4) letter substitution; 
(5) spelling; (6) alphabetical filing. These tests were given 
and graded by the same method as that used in the employ- 
ment office, and by the same examiners. 

The results of the study are shown in the following chart. 
For the sake of simplicity, actual averages are omitted and 
group ranks given instead. 







Group Tested 


No. in 
Group 


Rankifi 
Tests 


Rankin 
Educ. 


Rankin 
Age 


Average 
Age 


^1 


1. 


Recommended and hired 


287 


7 


7 


7 


21. 


s§ 


2. 


Recommended and not hired . 


137 


3 


3 


8 


21.1 


2I 


3. 
4. 


Not recommended— not hired 


173 


8 


9 


9 


21.9 


Not recommended but hired . 


19 


9 


8 


6 


20.8 
















a 


5. 


High school girls 


143 


1 


1.5 


3 


17.9 








J-r 


6. 


High school boys 


38 


5 


1.5 


2 


17.1 






Si 


7. 


X Business CoUcge (A. C.) . . . 


31. 


2 


6 


1 


16.2 


r 


8. 


X. Business College (B. C.) . . 


42 


4 


5 


4.5 


18.5 


£ 


9. 


Y Business College 


38 


6 


4 


4.5 


18.5 



Rank in education is based on the number of years completed 
in school. The high school seniors had almost twelve years 
of schooling to their credit and are therefore ranked highest 
in this respect. The group of applicants not recommended 
and not hired had only nine years of schooling to its credit and 
is ranked last. 

The results of this study showed very clearly : 
1. That the senior girls of the high school stood highest in 
their performance. On the basis of actual averages the per- 
formance of this group in the tests was 30% better than the 
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performance of Group 1, the group of applicants who were 
tested in the employment office, recommended, and hired. 

2. The group tested in the Employment Office and recom- 
mended but not hired (Group 2 on the chart) is the only group 
among those tested in the employment office which compares 
favorably with the high school girls and girls of the X business 
college (advanced class.) 

3. The pupils of the Y business college and of the beginners 
class of the X business college compare favorably with Group 
1, the group of applicants recommended and hired. 

4. Though the number of high school boys tested is com- 
I>aratively small, their perfonnance was considerably poorer 
than that of their girl classmates. 

5. There is the usual correlation between performance in 
tests and education, but a much less marked correspondence 
between rank in tests and age. 

Some of the above facts raised pertinent questions as to the 
existing employment methods. 

In the first place, if the girls reccnnmended by the psychologi- 
cal section of the employment office but not hired, represented 
the highest group of applicants, why were they not employed? 
The interview records showed that thirty-five of these appli- 
cants were either teachers or high 3chools pupils who wanted 
only summer work. Other reasons for not employing these 
applicants were: (1) They were already employed elsewhere; 
(2) the wages they demanded were above the starting rate 
for clerical work; (3) positions were not available at the time. 
With regard to the last two reasons, it was obvious that bet- 
ter rates and better selection mig^t be in order. 

In the second place, why were not more candidates secured 
from the high school and business collie graduating classes? 
If these girls were much better in the tests than those hired, 
it woud have paid to offer them higher wages than the existing 
standard maximum. Besides superiority in the tests, this 
group had the benefit of 2.3 years more of education. More- 
over, they were 2.9 years younger than the girls hired, a fact 
which would lessen the likelihood of their leaving on account of 
marriage. The hiring of a superior type of clerk would also 
make it possible to reduce the amount of equipment and super- 
vision required. Fewer desks, less space, less supervision, and 
fewer mistakes, all incident upon tfie employing of a better 
type of clerk, would warrant an increase in the wages paid. 

In the third place, why were nineteen girls who were not 
recommended by the psychological section, hired nevertheless? 
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Nineteen out of 616 is, to be sure, a small number. Of this 
number four had left or been discharged as unsatisfactory. 
Why .was the number of those leaving so small? Partly be- 
cause a majority of these girls had been brought in at the sug- 
gestion of department heads or friends. ^ It is difficult to check 
up the work of clerks hired in this way, largely because they 
are working among friends. However, it frequently happens 
that an unsatisfactory applicant is hired because of a pressing 
emergency. 

To sum up, the results of this study showed the importance 
of some knowledge of the available labor supply, and a basis 
upon which to determine its relative desirability. It showed 
that predetermined starting wa^^es had eliminated some of the 
most desirable applicants. It snowed that a system of flexible 
starting wages was highly desirable, if the wages could be 
varied in accordance with the quantity and quality of the 
available labor supply. These problems are. among the most 
important and recurrent which the employment manager has 
to deal with. 
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PICTURE COMPLETION 



RoBEET H. Gault, Northwestern University 



This paper rqwrts an attempt at scoring picture com- 
pletion records obtained from c«ie hundred and eighteen 
delinquents and dependents in the Juvenile Psychopathic 
Institute in Chicago. The major portion of the work was 
done by Mrs. Ruth Sanders Thompson, Fellow in North- 
western University during the academic year 1918-1919, under 
the direction of tiie Department of Psychology. 

To obtain the one hundred and eighteen cases, Mrs. Thomp- 
son read without omission, a block of nine hundred records 
that had been made prior to September 1918. These include 
all the records made at the Institute during a period of almost 
two years. From these were selected all those who had under- 
gone test by the Binet and the Stanford Revision, the Seguin 
Form board, and Healy's Picture Completion, (older form) 
and whose intelligence quotient was sixty or over. There was 
no other selection. The chronological ages of the cases range 
from seven years and no months to fourteen years and eleven 
months. Only two of these are at age seven years to seven 
years and eleven months, and four at age eight years to eight 
years and eleven months. It happens that the remainder of 
the one hundred and eighteen cases are almost equally divided 
among the ages nine years to fourteen years and eleven months. 
The intelligence quotients of seventy-four of these one hun- 
dred eighteen Juveniles are almost uniformly distributed over 
the range of sixty-five to 79.9 inclusive. Sixteen lie between 
sixty and sixty-four and nine tenths; fourteen are between 
eighty and eighty-four and nine tenths ; six between eighty-five 
and eighty-nine and nine tenths; five between ninety and 
ninety-four and nine tenths and the remaining three are be- 
tween ninety-five and ninety-nine. The mode, therefore, lies 
between seventy and seventy- four and nine tenths; rather 
nearer the latter figure than the former. 

The primary purpose in undertaking a study of these one 
hundred and eighteen, was to retest them by such means as 
should be deemed suitable, and in the light of the data thus 
obtained and in the light, too, of their recent social history, to 
return to an examination of the original findings. 

It is not my intention to enter into this aspect of the work 
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in this paper. The secondary purpose of Mrs. Thompson's 
investigation was to find the degree of correlation among the 
records of the children in the tests referred to above viz : The 
Binet Tests, The Stanford Revision, The Form Board and 
the Picture Completion Test. It is with this aspect of the 
work, particularly as it relates to the Picture Completion test, 
that I am concerned here. 

Naturally we first of all met the problem of scoring per- 
formance in the Completion Test. In the records of the 
Institute we found only an account of the moves made by 
each child: that blocks were placed here and there. We had 
before us Dr. Healy's method of scoring by " logical " and 
" illogical " errors, and Pinter and Anderson's method based 
upon the total frequency of choice of each of the blocks that 
were selected by their 1,438 presumably normal subjects. 
There is a possibility of 369 moves in this test. Our one hun- 
dred and eighteen cases made 360 of them as opposed to 349 
made by Pintner & Anderson's normal subjects. A few of 
our moves, therefore, have received no score in their scheme. 

Some of these were of such a nature that one could conceive 
of situations in which these moves could merit Pintner and 
Anderson's minimum score but not more than that. Accord- 
ingly we have assigned arbitrarily, a score of 0.1 to these 
cases and graded the one hundred and eighteen by the Pintner 
and Anderson scale. Correlation with 3ie Intelligence Quo- 
tient gives a result of 0.32. 

In reviewing the Pintner and Anderson scores I am 
impressed with the thought that in a great many instances 
associations to which a very low score had been given to their 
subjects because of their infrequency, may really appear to 
the juvenile to be a reasonable solution of a practical problem. 
The criterion of reasonability among these younger folk is 
already realised experience: it may be oft repeated or infre- 
quent, but striking. 

Possible experience is, on their part, never, or at best very 
infrequently, a criterion of reasonability. It should not even 
require pointing out that the reasonability, rationality, or 
logical character of behavior is determined by the way in 
which one uses the data of experience at one's hand. One 
may take all obtainable data into account and nicely balance 
one's course in the light of all the details conflicting or other- 
wise. (One may put the broken window in the window space.) 
In that case we should place a high rating upon the behavior 
or adjustment and we should describe it as logical with dis- 
tinction. We must remember that the phrase " all obtainable 
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data" means one thing for me and quite a different thing 
for the youngster in the back streets. 

One may overlook some of the details in the experience and 
suffer one's behavior or adjustment to the proWem to be 
determined by the striking or imusual circumstance. In such 
cases, too, we should usually ascribe some degree of rationality 
and logical character to the behavior. If a youngster has seen 
a bottle, of miJk toppling from a high window but yesterday 
and narrowly missing a pedestrian below it would be a rati(Hial 
procedure, indeed I may say logical, for him to place the 
block bearing an illustration of a milk bottle in the window in 
the test and he should have liberal credit for making his own 
picture. If, on his way up ^and down the street one of the 
youngster's frequent visual experiences comes to him from the 
ubiquitous milk bottle enframed in each window in a row of 
tenements, once more it should be deemed rational and logical 
for him to place the bottle in the window space, and particu- 
larly so if he has, on rare occasions, taken a crack at it with 
his sling shot. That the connection-window space-milk bottle- 
occurred in but 0.3%. of cases among Pintner and Anderson's 
subjects, and did not fall among the sixty-one most frequent 
cases, which they emphasize seems to me to be of less than 
great importance when one is attempting to build up a method 
of scoring that may be useful in estimating levels of intelli- 
gence. 

I chanced to alight upon the milk bottle just now when 
I glanced around for illustrative material. The necktie-win- 
dow, or the clock-window space connection or any one of a 
score of others, so varied is window furniture, embracing even 
socks, neckties and underdrawers, would have served my pur- 
pose quite as well. 

Indeed I am sure that cases may occur in which the baby- 
fruit connection should be given a high grade for its logical 
character. Many a child and youth comes into our juvenile 
courts in large cities who knows nothifig of picking fruit f romi 
a tree by the aid of a ladder and carefully placing it into a 
basket. Indeed we have not far to go to find youngsters even 
who do not know at all, or at best they know very vaguely, that 
fruit grows upon trees. Such a youngster may be dropping 
fruit upon the baby's head to tease him or may be bringing 
something pretty to comfort him. In either case, the reaction 
deserves a high grade for its logical and rational character. 
If you protest that any active and intelligent child will know 
and be able to appreciate the situation as you and I do, I can 
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reply only with the counter protest that your judgment is a- 
priori and, in addition, assert my belief that thousands of city 
children have at best but a vague book knowledge of f ruit-on- 
trees such as can hardly be said to have any value, even as 
second-hand experience, for directing behavior. 

Let me say furthermore, that the infrequent youngster of 
inventive disposition, provided he approaches the task of com- 
pleting the picture in a playful mood, as he should, will make 
imusual associations. It may appeal to his sense of humor to 
make the boy run away, not from the dog, but from the cr3dng 
baby, and very well for who whether adult or juvenile, likes 
to be in the vicinity of a crying baby? Yet this connection 
would doubtless appear so seldom that, in Pintner and Ander- 
son's scheme, no credit would be obtainable for it, or at best 
but a small credit, whereas, in the light of all the inner and 
outer circumstances, we should willingly give the performer a 
high grade for having made his own picture. 

Of course, you have leaped to the conclusion, and rightly, 
that I have now in the back of my head, a picture of a certain 
opposition between the so-called " objective " and the so-called 
** subjective " attitudes toward psychology and a suspicion that 
in this particular instance, at any rate, the so-called " objec- 
tive " attitude does not touch the psychological problem. • Hav- 
ing brought our psychology from one direction to the study 
of the individual, we ought not immediately to depart from 
the individual in another direction. We do so, if at all, at 
the peril of sacrificing the significance of psychology in its 
relation to human behavior. If we pin ourselves to the mere 
frequency of a form of behavior and imake that a criterion of 
high standing in a test we are bound to lose sight, in the 
shuffle, of that individuality that is so highly prized in the 
world because it makes things go. 

And so, as I said above, we came to the need for a method 
of scoring our one hundred and eighteen performances in the 
picture completion test. Dr. Healy's "logical" and "illogi- 
cal " or " rational " and " irrational " criteria gave us our 
starting point, and we were immediately before the question, 
*' what is logical ? " and " what is rational ? " 

We arbitrarily assigned a value of one hundred to the broken 
window in the window space and the same to each of the fol- 
lowing associations : running boy-dog ; wood cutter-log ; fruit- 
basket; milk-sleeping cat; playing boys-football; flying bird- 
tree; girl-hat; and chicken-chicken. The remainder of the 
sixty-one situations were then turned over to each one of a 
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group of eight including instructors and advanced students in 
Sie department of Psychology in Northwestern University, 
with the request that each one assign a value to each position. 
Each member of the group understood that he must needs keep 
in mind the possible motives of children such as come into the 
Juvenile Psychopathic Institute in a city like Chicago ; this means 
that each one should keep before him the possible backgrounds 
of individual experience among such youngsters. We then 
brought our ratings to the table. In many instances the values 
assigned to a given position varied so little among members 
of tfie group that we considered it safe to strike a simple 
average to obtain what we would accept as a final value. In 
other instances where a considerable divergence obtained we 
discussed the case thoroughly at the conference table. There 
we sought for all possible light upon the ways in which a 
youngster, genius or of common mold, could interpret the 
situation in question. Finally we came to practical agree- 
ment upon the question of value in every case and the simple 
average gave us the accepted final weight. This done, it was 
a simple matter to apply our scale to the records of the one 
hundred and eighteen cases and to find the correlation of the 
standings so obtained with the intelligence quotients. 

The correlation-Pearson coefiicient-between the grades of 
the one hundred and eighteen in the picture completion and 
the I. Q. was 0.41. The result is considerably lower in relation 
to the Binet 1911 series. 

We do not claim particular value for these results them- 
selves. It is probable that we assigned too great weight to 
particular situations. Nor do we ^attach great importance to 
our method of obtaining a scale in as far as that method con- 
sists in sitting round a table in a suburban town seeking 
agreement of opinion as to what may have been the motives 
of back-street children in Chicago a year earlier or more 
when they placed a pot of flowers or a milk bottle in the win- 
dow space in the picture. It does represent, however, an 
honest eflfort to take advantage of the psychologic background 
of the exceptional child. 

I believe finally that the criteria employed by Dr. Healy are 
capable of development along the lines suggested in our crude 
experiment, and I have only this to propose that investiga- 
tors, in their use of picture completion tests make every eflfort, 
by conversation with each individual under test to discover his 
motive for his several choices. When this has been done to 
the fullest extent possible, and when these motives have been 
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Studied in relation to the social history of each case, it will 
be possible ultimately to assign a weight to each choice or 
move varying with the types of experience represented. A 
given youth may receive a high grade .for a certain perform- 
ance and another a lower grade for the same reaction. What 
seems, to the adult placed as we are here, an illogical reaction 
may in the light of our research be logical. 

I am aware that this suggestion points to a heavy tedious 
task but I am convinced that it oflFers one method of giving 
proper wei^t to experience in our psychological tests. 
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A COMPARATIVE STUDY OF THE INTELLIGENCE 

OF SEVENTY-FIVE WHITE AND FIFTY-FIVE 

COLORED COLLEGE STUDENTS BY THE 

STANFORD REVISION OF THE BINET- 

SIMON SCALE 



By S. M. Derrick, M. A., University of South Carolina 



The study of the comparative intelligence of the negro and 
white races has engaged the attention of students only in recent 
years. The first investigation of this kind was made at the 
University of South Carolina in 1913 by Miss Strong (14). 
Since then similar studies have been made which have in the 
main corroborated the results secured by her. The investiga- 
tions made by Sunne (13), Pressey (9), Phillips (8), Perring 
(6), Pyle (10), Odom (5) and others show that age for age 
the negro student is younger mentally than the white. 

These studies were made with the grammar grade pupils 
exclusively. The present study tmdertakes to extend the inves- 
tigation to the college students of both races.* It shall be the 
purpose of this paper (1) to make a comparison of the ages 
of the two groups of college students, (2) to make a com- 
parison of the intelligence, (3) to determine the correlation 
of mental ability with school success, (4) to determine the 
correlation of mental ability with environment, and (5) to 
determine the difference in the specific mental traits of the 
two races. 

This study was made at the University of South Carolina. 
The seventy-five white college students tested were students 
of the University, the majority being members of the Fresh- 
man and Sophomore classes. They were imselected students 
with whom the examiner was not acquainted previous to the 
testing. In the main, the students were tested in their own 
rooms. This was found to be the most convenient place and 
was favorable to the correct attitude on the part of the sub- 
jects. Care was taken to exclude all other persons from the 
room and distractions were kept to a minimum. The testing 

^The work of Strong has been of valuable assistance in this con- 
nection, as have been die works of the other students of the races, 
referred to above. Many valuable suggestions have been received 
from Terman (16) as to the technique of administering the test 
The writer is also deeply grateful to Dr. Josiah Morse for his sym- 
pathetic interest and helpfid criticisms in die making of this study. 
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was done quietly and only when la subject could be found who 
had the time to give freely. Usually from forty-five to sixty 
minutes were consumed, depending of course upon the reaction 
of the individual. The tests were entered upon with interest, 
if not with zest. All seemed at ease and enjoyed the time 
spent. 

The fifty-five colored students were secured at two colored 
institutions in Colimibia; namely, Benedict College and Allen 
University. Subjects were secured from every class in col- 
lege. However, due to the scarcity of collie students it was 
foimd necessary to take a few men from the two upper classes 
of the high school. But these were all above the age of 16. 
Everything was done to make the work both pleasant and 
profitable. Favorable circumstances existed and the writer 
did not have any difficulty in getting the subjects to feel at 
ease. Marked interest was shown and enthusiastic endeavor 
was manifested. The work was thoroughly enjoyed, and to 
the authorities the writer is deeply grateful. 

In this testing the Stanford Revision of the Binet-Simon 
Tests was used and the directions given by Terman were fol- 
lowed very closely. All responses were marked + or — . It 
was not possible to have a second person to keep a full record 
of all that the pupils said and did, but the examiner kept in 
his note-book as many as possible of the answers to the defini- 
tions, problem questions, diflference between abstract words, 
and the interpretation of fables. 

Age Comparison 

No student below the age of 16 years was tested. Terman 
states that at this age the student has reached his maximum 
performance in the test, that is, after this stage of his develop- 
ment added years do hot increase his intelligence quotient. 
The 75 white college students ranged from the age of 16 to 25 
inclusive. However, these were unevenly distributed, the 
greater number lying at the lower end of the range. The 
median age for the entire (number was 19. 

The number and percentage of ttudenta at each age waa as follows: 

Age 16 17 18 19 20 21 22 23 24 25 

Nnmber 7 14 20 14 10 7 1 1 — 1 

Ptecent 9.3 18.7 26.7 18.7 13.3 9.3 1.3 1.3 1.3 

It will be seen that 26.7% are 18 years of age; also, that 
there are just as many one year above the median age as there 
are one year below. It is interesting to note that only 4% were 
above the age of 21. Some of the students are retarded in 
their schooling, but it was practically impossible to ascertain 
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how many, or to what extent. Some entered college from the 
third year of the high school, while some entered from the 
fourth. Not a few spent one year or more out of school 
engaged in work, due to the demands of war, while many 
had seen military service. These circumstances would neces- 
sarily make any attempt to determine the amount of scholastic 
retardation futile. 

The distribution of the am of the 55 colored ttudenta was through a wider range— 
from 16 to 35 inclttstve. Thenumber and percentage for each year loUows: 

Age 16 17 18 19 20 21 22 23 24 25 

Nomber 6013 94 6321 

Percent 10.9 — 1.8 5.5 16.4 7.3 10.9 5.5 3.6 1.8 

(Continued) 

Age 26272829 30 31 323334 35 

Number 5422 02 3101 

Percent 9.1 7.3 3.6 3.6 — 3.6 5.5 1.8 — 1.8 

The highest percentage of n^roes found at any group was 
16.4% at 20. The median for age is the same as the mode. 

As with the whites it was impossible to determine the 
amount of school retardation. In fact, the task would have 
been even more difficult. A few of the students tested were 
found to have been out of school for as long as ten years 
before attempting to enter college. Due to the economic 
and social conditions under which they lived, they were forced 
to woric some and then go to school. So varied were the 
causes that kept them from college, that no standards could 
be devised by which the amount of retardation could be deter- 
mined. 

The median age of the whites is two years less than the 
median age of the neg^roes, and the average age of the whites 
is five years less than that of the neg^roes. 

The oldest negro is ten years older than the oldest white; 
34.5% of the negroes are above the age of the oldest white, 
while only 10.9% lie below the median age of the whites. Also, 
73.4% of the whites are below the median age for the negroes. 
From these comparisons it is evident that the n^^o college 
student is older than the white. 

Comparison of Intelligence Quotients 

According to Terman (16) The average intelligence quotient 
of collie students should be 115, the highest possible score 
being 1^. The average for the 75 white college students tested 
was 112. Many of the students passed two or more of tiic 
" Superior Adult Test," and had there been higher tests tiiey 
might have increased their intelligence quotients. 

Of the total number of white students 40% tested above 
112, the average, while 57% tested below. More students tested 
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at 108 than at any other point, the number being 10, or 13% 
of the total. See table I, section A. 

TABLE I 
Intelligence Quotients op Whttbs and Negroes 
(A) 75 White Collie Students (B) 55 J^egro Collie Studento 



LQ. 


Number 


Percent 


LQ. 


Number 


Percent 


70-80 








70-80 


1 


1.8 


80-90 








80-90 


4 


7.4 


90-100 


5 


6.7 


90-100 


15 


27.3 


100-110 


34 


45.3 


100-110 


24 


43.7 


110-120 


26 


34.7 


110-120 


10 


18.2 


120-130 


10 


13.3 


120-130 


1 


1.8 



Average I. Q. = 112d:6. 



Average I. Q. »« 103±7.8 



All the white college students tested at or above average 
intelligence. Of the 75 students 53% tested at average, and 
47% above, 30.7% being between 105 and 110, 14.7% being 
between 100 and 105, and only one being below 100. Of the 
entire number 38.6% tested at superior intelligence and 14.7% 
at very superior. 

When the intelligence quotients of the negro are analyzed 
the most striking thing is their wide distribution. They range 
from 76 to 125. The average for the negroes is 103 or 12 
points below Terman's average intelligence quotient, and 9 
points less than the average for the whites. The mean varia- 
tion was 7.8. 

Of the 55 tested, 9.2% tested below average intelligence. 
Thirty-nine or 71.0% tested between 90 and 110, average intel- 
ligence. However, there was a greater percentage in the upper 
half of this range, 23.6% having tested between 105 and 110, 
16.4% between 100 and 105. Ten or 18.2% made a score of 
108, the largest number at any one intelligence quotient. It 
is interesting to note further that 18.2% of the negroes tested 
at superior intelligence and 1.8% at very superior. A greater 
percentage of the negroes tested above average intelligence 
than below, 20.0% having tested above and 9.2% below. 

More students from both races tested at 105-110 than at 
any other five-point group. Of all the whites 9.3% tested below 
the average for the negroes, 83.6% of the negroes tested below 
the average for the whites. 

While the scale of intelligence quotients for the negroes ex- 
tends lower than that of the whites, it ranges approximately 
as high. The highest score made by any colored student was 
125 : the highest made by any white student was 128. Odom 
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(5) lodes upon this fact with optimism for the n^ro. He 
claims that the fact that the records of a limited nimiber of 
negroes equal the records of the best whites gives indication 
of larger possibilities for the former. 

It will be of interest to note the variability of the two races. 
Mayo (4) found that the negro was about 90% as variable as 
the white in scholastic attainment. In the present study the 
opposite is found to be the fact; the whites are only about 
77% as variable as the negroes. This would indicate that we 
should expect to find more inferior people among the negroes 
than among the whites. 

A comparison of the average intelligence quotients of the 
different age groups, and also of the mean variations is of 
interest at this point. The table below is a simunary of the 
results obtained : 

TABLE II 
Average Score and Mean Variation op Each Age Group 
(A) 75 White College Students (B) 55 N^:ro Collie Students 







Average 


Mean 


Number 


Average 


Mean 


Age 


Number 


Score 


Variation 




Score 


Variation 


16 


7 


110 


6.6 


6 


114 


4.7 


17 


14 


110 


5.1 











18 


20 


113 


5.4 


1 


94 





19 


14 


111 


7 


3 


109 


2.3 


20 


10 


111 


4.8 


9 


102 


5.1 


21 


7 


113 


5.6 


4 


100 


10 


22 


1 


106 





6 


95 


8.3 


23 


1 


100 





3 


99 


9.3 


24 











2 


104 





25 


1 


111 





1 


107 





26 








5 


102 


5.4 


27 








4 


109 


3.5 


28 








2 


110 


2.5 


29 








2 


105 


2.5 


30 

















31 








2 


106 


5.5 


32 








3 


94 


8.3 


33 








1 


94 





34 

















35 








1 


106 






No very pronounced difference exists between any age group. 
An 18 year old student made the lowest score of any of tiie 
whites, while the highest score was made by a student of 19. 
The mean variation of each age-group varies more than the 
average intelligence quotients of each group. The lowest is in 
the ^year group where the average deviation is 4.8, the 
highest is in the 19-year group where it is 7. 
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A similar condition is noted among the n^^roes. However, 
the average score for each age-group of ncg^roes varies through 
a wider range than does the average score for each age-group 
of whites. Also, the mean variation of the different groups 
vary widdy, ranging from 2.3 to 10. See table II, section B. 

One of the most outstanding facts is the comparative high 
score made by the 16-year old negroes. The average intelli- 
gence quotient of this group is two points higher than average 
for all the negroes, four points higher than the average for any 
other age-group of negroes one point higher than the average 
for any group of whites and two points higher than the average 
for all the whites. While the number is small the comparison 
is nevertheless interesting. The mean variation of the 16-year 
group of whites is higher than for the negroes, the figures being 
6.6 and 4.7 respectively. The highest score made by any 16- 
year old. white is 123, while the lowest is 101 ; the highest for 
the same age-group of negroes is 125, while the lowest is 107. 
It was a 16-year old student that made the highest score made 
by any n^o student. The only other age group in which 
anything like a comparison can be made is the 20-year group. 
The average score of the negroes in this group is 102 with a. 
mean variation of 5.7 ; the average score of the whites in this 
group is 111 with a mean variation of 4.8. However, when the 
average score of each age group of whites is compared with 
the average score of each similar age group of negroes it is 
found that in the main the whites rank higher than the negroes* 

Correlation of School Success with Intelligence Quotients 

Terman (15) classified the school success of 504 children into 
five grades : very inferior, inferior, ca/erage, superior and very 
superior. Similarly the college work of the 75 white students 
tested was classified. The grades for the making of this classi- 
fication were secured from the Dean's Office of the University, 
The number and percentage in eadi group is here given in 
Table III. 

TABLE III 

Comparison op School and Test Rating (White) 

No. School Test Average Mean 
Gnmp Students Rating Rating Score Variatioxx 

Very Inferior 6 8% 106 2 

Inferior 23 30.7 106 3.8 

Average 18 24. 52% 113 3.6 

Suporor 17 22.7 34.7 113 5.9 

Very Superior 11 14.6 13.3 121 4.5 
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When this grouping is compared with that made on the 
basis of the intelligence quotients it is seen that the agreement 
below the average school success is not very close. In fact no 
white college student tested below average intelligence, while 
29 or 38.7% are doing inferior and very inferior collie work. 
However, a majority are doing average to very superior col- 
lie work, the number being 46, or 61.3% of the total. It 
would seem that the college work of the students is below 
their capacity, as revealed by the test. 

It will be seen that the average score of each of the three 
lower school success groups is too high, but that the superior 
and very superior show a very close correlation. One rather 
striking fact brought out was that the subject tiiat made an 
intelligence quotient below 100 is doing superior college work. 
However, the one that scored highest in the test is doing very 
superior college work. There are some rather serious dis- 
agreements. Many of those that are doing inferior to very 
inferior collie work tested relatively high. But it must be 
remembered that school success rests on other factors than 
intelligence, such as application, quality of instruction, health, 
motive and interest. In spite of these considerations the cor- 
relation between school success and the intelligence quotients 
is high, it being .70 according to Pearson's formula (12). 

The school success of the neg^roes was secured from tiie 
authorities of the two negro institutions. The number and 
percentage in each group is given in the following table. In 
6ie third column are the percentages determined by the tests. 

TABLE IV 

Cc»iPARisaN OP School and Test Rating (Negro) 

No. School Test Average Mean 
Group Students Rating Rating Score Variation 

Very Inferior 3 5.4% 1.8 99 9.7 

Infeior 9 16.4 7.4 99 6.6 

Average 15 27.3 70. 99 7.5 

SupOTKW 18 32.7 18.2 107 5.3 

Very Superior 10 18.2 1.8 109 5.1 

The above figures indicate that ,the school work of the negroes 
is given a higher rating by the teachers than it deserves. An 
interesting fact is that the percentage that tested above average 
intelligence is nearly identical with the percentage classed as 
doing average college work. 

No difference at all is found in the average score of the 
three lower groups, each being 99. However, it will be seen 
that the very inferior group is more variable than the other 
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two groups. But the number is so small that the comparison 
could not at all be fair. Some rather serious disagreements 
are noted here. In only one group does the average score 
correspond to the classification bas«I on school success, that 
is, the average group. But as a whole the correlation is found 
to be rather high, it being .50. 

One important consideration must be borne in mind when a 
comparison is made between the two groups of students — the 
difference between the standard of the negro institutions and 
the standard of the white institution. According to the rating 
of the two negro institutions given in Bulletin 1916, No. 39, U. 
S. Bureau of Education, the standards required to be main- 
tained by the negro students are inferior to those required to 
be maintained by the white students. On the other hand it 
is reasonable to suppose that the average negro who has the 
opportunity to attend coll^[e puts forth greater effort than the 
average white student, which may account for the fact that the 
negro's school work receives a rating superior to his intelli- 
gence quotient, whereas the white student's school woric is 
inferior to his intelligence quotient. 

In every school success group the average intelligence 
quotients of the whites is greater than that of the negroes, and 
the mean variation is less except in the superior group in which 
it is .6 higher. Further there is a lower degree of correlation 
between the school success and intelligence of the negroes than 
there is between the school success and intelligence of the whites. 

Correlation of Environment with Intelligence Quotients 

In making a comparison of the environments of the two races 
with the intelligence quotients it must be kept in mind that the 
average environment of the negro is much inferior to that of 
the white. The environment that would be considered average 
or even inferior for the white, would be considered superior 
for the negro. However, this fact will not prevent the making 
of some interesting comparisons. 

The environments of the whites were classed into five 
groups ; namely, very inferior, inferior, average, superior and 
very superior. Of the 75 tested, not one was found to have 
very inferior environment. The greatest percentage was found 
in the average group, there being 45.3%. Only 8% were classed 
as inferior ; 36% were in the superior g^oup and 10.7% in the 
very superior. Combining these figures we have 46.7%of the 
white college students from above average environment, with 
only 8% below. 
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When the intelligence quotients of the environmental groups 
are analyzed it is found that there is a rather high degree of 
correspondence. The coefficient of correlation is .85. Each 
higher environmental group has a higher average intelligence 
quotient than the preceding one. A summary of the results 
is given in table V. 

TABLE V 

Comparison op Environmental and Test Rating (Wmis) 

No. Environ. Test Average Mean 
Group Students Rating Rating Score Variation 

Very Inferior 

Inferior 6 8% 103 5.7 

Average 34 45.3 52. Ill 5.9 

Super&r 27 36. 34.7 112 5.4 

Very Superior 8 10.7 13.3 118 4.0 

The mean variation of each g^oup does not vary widely from 
the variaticm of every other g^oup. The smallest is in the 
very superior group, meaning that the students in this group 
test very superior to a greater degree than those in the superior 
environmental group test superior, those in the average group 
test average or those in the inferior group test inferior. 

When the colored students were classified as to environment, 
none was found in the very inferior group, 7.3% were in the 
inferior group, 23.6% in the average, 52.7% in the superior 
and 17.3% in the very superior. It is a rather a striking fact 
that a comparatively small percentage of the negro students 
are classed as being from inferior or average environment, 
there being 70% from above the average negro envircMiment. 
This seems to indicate that only those negroes from the best 
homes and most (progressive communities go to college to any 
extent 

When the envircmment is correlated with the intelligence 
quotients the agreement is found to be rather close, the 
coefficient of correlaticm being .70. A summary of the results 
is given below in table VI. 

TABLE VI 

Comparison op Envirc»4mental and Test Rating (Negro) 

No. Envin>n. Test Average Mean 
Group Students Rating Rating Score Variation 

Very Inferior 1.8 

Inf^ 4 7.3% 7.4 96 8.0 

Average 13 23.6 70.0 99 8.2 

Sup^ 29 52.7 18.2 104 6.0 

VerySuperiOT 9 17.3 1.8 110 6.6 
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The superior environmental group shows less variability 
than any other, while the average group shows the greatest. 
However, the range of the g^oup variation is not very wide, it 
being from 6 to 8.2. 

In every environmental group the average score of the 
white students is higher than that of the negroes and the mean 
variaticHi is less. The negro college student is from a better 
n^;ro environment than the white is from a white environ- 
ment. Seventy per cent of the negroes are from above the 
average environment, while only 46% of the whites are from 
such. This indicates that white boys from the average white 
environment go to collie nearly twice as frequently as do the 
n^;ro boys from the average negro environment. 

There is a higher degree of correlation between the envircm- 
ment and the intelligence quotients of the whites than there 
is between the environment and intelligence quotients of the 
n^froes, the coefficients being .85 and ./O respectively. 

The conclusions reached here are in accord with those of 
the other investigators in this field. Pyle (2) says that the 
good social group of the negroes stands about midway between 
the poor social group and the good social group of the whites. 
Ferguson ( 1 ) states that the negro boy from a good social group 
makes about three-fourths the showing of the white. Odom 
(5) and Phillips (8) in the main, corroborate this. Odom (5) 
say that " it would be clearly impossible for the negro to show 
the same manifestations of mental traits as whites after having 
been under the influence of an entirely different environment 
for many generations," 

Specific Differences 

The responses of both races, both successes and f ailtu*es, cor- 
respond to the specimen answers given by Terman (16) and 
others. The percentage of white and colored students that 
passed each specific test is given below for both races in table 
VII. 

TABLE VII 

Negroes Whites 

Year XIV 55 75 

Vocabulary, 50 words 87% 99% 

Induction Test 78 96 

Difference between President and King 96 92 

Problems of Fact 95 99 

Arithmetical Reasoning 89 99 

Reversing Hand of Clock 75 85 
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TABLE yil'-Omiimied 

Negroes Whites 

Year XVI 54 75 

Vocabulary; 65 words 46% 60% 

Interpretatioo of Fables 75 82 

Diffqyce between Abstra ct Words 89 74 

R e pe ats 6 Digits Reverted 51 54 

Code 22 60 

Year XVIII 38 74 

Vocabulary, 75 words 5% 21% 

Billet's PtacrCottiiv Test 49 82 

RQ»Bits8I>«ito 29 32 

Repeats Thocu^ al Pusages 10 44 

Repeats 7 Di^ Reversed. 15 18 

Ingenuity Test 25 63 

Year XIV. 

The n^^roes were more successful in giving the difference 
between a president and a king than in any other test, 96% 
giving at least two of the three differences correctly. Also the 
n^^roes did well with the proUems of fact, 95% passing it cor- 
rectly. Of all the tests in this group they did poorest in chang- 
ing the hands of the clock. Sunne (13) also found this oHicU- 
tion and suggests that it may be due to Uie lade of acquaintance 
with a timepiece. This, however, is hardly true for coll^;e 
n^^roes, who, as we have seen, come from superior n^ro 
envircmment. More probably it is due to the inability to reason 
the problem out. 

Practically all the white students were able to pass all the 
tests of this group. Reversing the hands of the dodc was 
found to be the most difficult, 85% being able to pass it Over 
90% were able to pass the other tests. 

Year XVI 

This group was not given to one of the negroes, due to the 
fact that he failed to pass more than one of the tests in the 
preceding year group. The negroes were most successful in 
giving the difference between abstract words, 89% having been 
able to pass this test. They were least successftd with the code, 
only 22% doing it well enough to make a pass. They were 
also rather successful in the interpretation of fables, 75% 
interpreting four of the five correctly. 

The interpretation of fables proved to be the easiest for the 
whites in tiiis group, 82% passing it; while repeating six 
digits reversed proved to be the most difficult with 54% repeat- 
ing them correctly. 
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Year XVIII 

The greatest success ,was with Binet's paper cutting test, 49% 
of the n^^roes doing it correctly. It is a rather striking fact 
that only 5% were able to pass the vocabulary test of this 
group. 

Binet's paper cutting test proved easiest also for the whites, 
82% passing it. The repeating of seven digits reversed was 
the most idifficult, only 18% repeating them correctly. 

In every test the percentage of passes registered by the 
whites is greater than the percentage registered by the negroes, 
except in giving the difference between a president and a 
king, where the negroes excelled the whites by 4% ; and giving 
the diflference between abstract words, where the whites are 
excelled by 15%. This would seem to indicate that the negro 
is superior to the white in discrimination and abstraction. 
However, it seems reasonable to suppose that in the giving of 
the difference between abstract words the peculiar training of 
the neg^o has determined his success. It has been drilled into 
him by his teachers that there is a decided diflference between 
poverty and misery, laziness and idleness, and reputation and 
character. No doubt that training also enters into his success 
in the interpretation of fables. It is characteristic for the 
n^^o to teach and preach by the use of moralizing stories and 
fables. 

The conclusion of Pressey and Teter (9) that the negro is 
better in concrete and routine problems than in problems 
involving mental abstractions or reconstruction is found to be 
generally true in this study. The conclusion of Sunne (13) 
that colored children find it diflficult to reverse the hands of the 
clock is corroborated, but his conclusion that the problems of 
fact were diflScult is not. The code was not found to be easier 
for the negroes than for the whites as is stated by the same 
investigator. The conclusion of Phillips (8) that the negro is 
slower in response and less animated was not corroborated by 
this study. Sunne (13) could find no such diflference. 

One of the most striking things brought out in the testing of 
the negroes was the answers given to the first problem in the 
" Problems of Fact *' test. Fifty per cent of them either said 
that a man was lynched or a man was shot by a mob. Very 
few such answers were given by the white students. This 
fact would tell an interesting story to a psycho-analyst. 



Digitized by 



Google 



328 DERRICK 

Summary 

1. The n^^o college student is older than the white; and 
according to chronological age he is more retarded. 

2. The white coll^;e students have a higher average intelli- 
gence quotient than the negroes, their average score being 9 
points higher. 

3. The range of the intelligence quotients of the n^roes was 
wider than that of the whites, the range of the former was 
from 76 to 125 and that of the latter was from 91 to 128. 

4. The white college student was about 77% as variable as 
the negro. 

5. The average intelligence quotient of the 16 year old 
negroes is higher than average for any other age group of 
either race. 

6. The college work of the white college student is inferior 
to his ability as Imeastu^ed by the test. 

7. The college work of the negroes is given a higher rating 
by the teachers than it deserves according to the test. 

8. In every school success group the average intelligence 
quotient of the whites is higher than that of the negroes, and 
the mean variation is less in every group except in the superior 
group where it is .6 higher. 

9. There is lower degree of correlation between the school 
success and intelligence quotients of the negroes than between 
the school success and intelligence quotients of the whites ; the 
coefficient of correlation of the former being .50, that of the 
latter being .70. 

10. In every environmental group the average score of the 
whites is higher than that of the negroes, and the mean varia- 
tion is less. 

11. White boys from average environment go to college 
nearly twice as frequently as negro boys from average negro 
environment. 

12. There is a higher degree of correlation between the 
environment and intelligence quotients of the whites than there 
is between the environment and intelligence quotients of the 
negroes, the coefficients of correlation being .85 and .70 
respectively. 

13. From this study it seems that the negro is better in 
memory and in concrete and routine problems than in those 
that involve mental abstraction and reconstructicMi. 
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THE EFFECT OF CLIMAX AND ANTICLIMAX 
ORDER OF PRESENTATION ON MEMORY 



By HsNKY Foster Adams, University of Michigan 



In previous papers,* the memory efRdency of size of adver- 
tisements, of their frequency of presentaticm with both dupli- 
cation and variation, and of mixed sizes of advertisements, 
have been discussed. In the last paper mentioned, it was 
found that the memory value of the same total amount of 
space varied as it was made up of different combinations of 
sizes. For instance a series made up of 3 half and 1 quarter 
page advertisements of the same commodity was found to 
have a greater memorability than a similar series composed 
of 1 full and 3 quarter pages, yet the total area is the same in 
both cases, L75 pages, and the number of presentations is 4 
in each case. 

But a question ivhich was left unsolved in that experiment 
was whether the order in which the mixed sizes were pre- 
sented to the subject had any effect upon the memorability 
of the series. For example, if a firm advertises 4 times with 
mixed sizes of advertisements, is it more effective upon 
memory to present the larger sized advertisements at the 
b^inning or end of the series. 

To test the point 3 dummies were prepared, as follows. 
In dimimy A, for instance, each firm advertised 4 times, the 
different insertions being variations and at least two sizes 
of advertisements bdng included in the 4 insertions. Each 
different arrangement of sizes was likewise represented by 
four different firms. With two of the firms, the larger si?es 
appeared first, followed by the smaller ones and with the other 
two firms for the same combination of sizes, the advertise- 
ments of smaller area appeared first, followed by the larger 
ones. In all, the following combinations were presented: — 

^ The Relative Importance of Size and Frequency in Forming Asso- 
ciations, /. of Phi!., Psy,, and Set, Meth., Vol. XII, 1915, pp. 477-491. 

The Relative Memory and Values of Duplication and Variation in 
Advertising, ibid., Vol. XIII, 1916, pp. 141-15Z 

The Memory of Mixed Sizes of Advertisements, /. of Exper, Psychol 
VoL II, 1917, pp. 448-465. 
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Dummy ABC 

FFFH 
HFFF 
FFFQ 
OTFF 
FPHH 
HHFF 



FFQQ 
QQFF 



FFHQ 
QHFF 
TOHH 
HHHF 




2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 

2 2 2 



48 48 48 144 

In the experiment, part of the subjects began reading the 
dummy at page 1 and went along progressively to the end; 
others began at the end and read back to page 1. This was 
easily accomplished by turning the dummy upside down. 
Therefore, to those subjects who read the dummy through 
in the forward direction, the advertisements of a certain firm 
would be seen in the order FFFH ; while to those who read 
it through in the reverse direction, the same advertisements 
of the same firm would appear in the order HFFF. In this 
way each series of advertisements was seen by the subjects 
in both the climax and anti-climax order. For the sake of 
ccmvenience of expression, the series of advertisements is 
said to be in the climax order if .the smaller spaces appear 
first followed by the larger ones; in the anti-climax order 
if the larger spaces are seen first followed by the smaller 
ones. 

With dummy A, 93 subjects were used in the direct or 
forward order of reading, 68 in the reverse order ; in dtunmy 
B 95 in the direct order, 58 in the reverse ; in dummy C 79 in 
the forward order and 70 in the reverse order. This makes a 
total of 463 subjects. 
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Since the results of the experiments may be considered in 
several ways and the conclusions to be dralvn from the experi- 
ment depend in part upon the method of treatment, the original 
data will be presented. It is given in Table I. 











TABLE I 














Order 




Dummy A 






Dummy B 






Dummy C 


of Adt. 


D 


R 


Ant 


CU 


D 


R 


Ant 


ai 


D 


R 


Ant 


at 


FFFH 


137 


103 


137 


103 


53 


29 


53 


29 


92 


76 


92 


76 




78 


64 


78 


64 


48 


21 


48 


21 


48 


52 


48 


52 


HFFP 


70 


65 


65 


70 


49 


30 


30 


49 


72 


71 


71 


72 




70 


53 


53 


70 


58 


34 


34 


58 


69 


92 


92 


69 








333 


307 






165 


157 






303 


269 


FFFQ 


74 


56 


74 


56 


49 


26 


49 


26 


76 


81 


76 


81 




121 


82 


121 


82 


38 


18 


38 


18 


84 


71 


84 


71 


QFFF 


104 


86 


86 


104 


36 


11 


11 


36 


32 


34 


34 


32 




51 


37 


37 


51 


53 


28 


28 


53 


52 


49 


49 


52 








318 


293 






126 


133 






243 


236 


FFHH 


55 


42 


55 


42 


44 


22 


44 


22 


66 


81 


66 


81 




71 


62 


71 


62 


50 


22 


50 


22 


17 


35 


17 


35 


HHPP 


91 
110 


66 
91 


66 
91 


91 
110 


83 
23 


50 
11 


50 
11 


83 
23 


22 
87 


37 
89 


37 
89 


22 




P 








283 


305 






155 


150 






209 


225 


PFQQ 


23 


22 


23 


22 


57 


15 


57 


15 


87 


101 


87 


101 




115 


87 


115 


87 


57 


29 


57 


29 


95 


81 


96 


81 


QQFP 


28 


39 


39 


28 


33 


22 


22 


33 


107 


113 


113 


107 




32 


38 


38 


32 


100 


61 


61 


100 


35 


47 


47 


35 








215 


169 






197 


177 






342 


324 


FFHQ 


•77 


51 


77 


51 


27 


5 


27 


5 


22 


22 


22 


22 




57 


45 


57 


45 


114 


54 


114 


54 


36 


57 


36 


67 


QHFP 


76 


61 


61 


76 


30 


15 


15 


30 


89 


95 


95 


89 




36 


30 


30 


36 


37 


17 


17 


37 


55 


67 


67 


55 








225 


206 






173 


126 






220 


223 


PHHH 


60 


41 


60 


41 


59 


26 


59 


26 


18 


27 


18 


27 




65 


36 


65 


36 


101 


61 


101 


61 


118 


110 


118 


110 


HHHF 


88 


57 


57 


88 


18 


7 


7 


18 


106 


91 


91 


106 




60 


63 


63 


60 


55 


27 


27 


55 


61 


53 


53 


61 








245 


225 






194 


160 






280 


304 


FQQQ 


70 


68 


70 


68 


65 


30 


65 


30 


25 


23 


25 


23 




24 


10 


24 


10 


45 


10 


45 


19 


59 


61 


59 


61 


QQQF 


81 


28 


28 


31 


74 


43 


43 


74 


44 


65 


65 


44 




50 


36 


36 


50 


52 


21 


21 


52 


96 


87 


87 


96 








155 


159 






174 


175 






236 


224 


FHHQ 


27 


26 


27 


26 


24 


10 


24 


10 


59 


62 


59 


62 




33 


26 


33 


26 


105 


43 


105 


43 


41 


50 


41 


50 


QHHF 


50 


49 


49 


50 


63 


34 


34 


63 


104 


83 


83 


104 




9 


12 


12 


9 


13 


8 


8 


13 


35 


46 


46 


36 








121 


111 






171 


129 






229 


251 


FHQQ 


42 


38 


42 


38 


37 


21 


37 


21 


77 


78 


77 


78 




60 


40 


60 


40 


97 


48 


97 


48 


92 


88 


92 


88 


QQHF 


91 


84 


84 


91 


29 


17 


17 


29 


52 


70 


70 


52 




35 


40 


40 


35 


66 


28 


28 


66 


12 


15 


15 


12 








226 


204 






179 


164 






264 


230 
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TABLE 


I— C 


onUm 


4€d 










o?Si. 


D 


Dummy A 
R Amt 


CU 


D 


Dummy B 
R Ant 


CU 


D 


Dummy C 
R Ant CU 


HHHQ 

QHHH 


72 

i! 

24 


54 
40 
22 
15 


72 
58 
22 
15 


54 

40 
21 
24 


16 
20 
79 
33 


4 
14 
30 
19 


16 
20 
30 
19 


4 
14 
79 
33 


64 
66 
62 
31 


50 
62 
65 
51 


64 50 
66 62 

65 62 
51 31 








167 


139 






85 


130 


246 205 


HHQQ 

QQHH 


5 
71 
U 
11 


10 
46 
10 
10 


5 
71 
10 
10 


10 
46 
11 
11 


8 
71 
48 
16 


6 
23 
16 

8 


8 
71 
16 

8 


6 
23 
48 
16 


39 
30 
86 
36 


52 
45 
79 
28 


39 52 
30 45 








106 


78 






103 


93 


166 219 


HQQQ 

QQQH 


9 
17 
12 

5 


12 

8 

23 

10 


9 
17 
23 
10 


12 
8 

12 
5 


18 
87 
18 
83 


5 

47 

9 

46 


18 

'I 

46 


5 
47 
18 
83 


18 
15 
65 
17 


22 
25 
37 
22 


18 22 
15 25 
37 65 
22 17 








59 


37 






160 


153 


92 129 



The column of initials, at the left gives the order of presenta- 
tion of the advertisements, F standing for full page, H for 
half page and Q for quarter page. The second, labeled D, 
gives the gross credits received by the various series of adver- 
tisements when the subjects read in the forward or direct 
order, starting at page 1. The third column, labeled R gives 
the gross cr^its received by the advertisements when the 
dummy was read through in the reverse direction. The fourth 
column, headed by Ant. gives the credits for the advertise- 
ments which were read through in the anti-climax order ; and in 
the fifth column, headed Cli. the credits for those advertise- 
ments which were read through in the climax order. The 
other columns gives the same data for dummies B and C. 

TABLE II 





Dummy A 
Anti ai 


Dummy B 
AnU CU 


Dummy C 
Anti CU 


AnU^ CU 


FFFH 


333 
318 
283 
215 
225 
245 
155 
121 
226 
167 
106 
59 


307 
293 
305 
169 
206 
225 
159 
111 
204 
139 
78 
37 


165 

lit 

197 
173 
194 
174 
171 
179 
85 
103 
160 


150 
177 
126 
160 
175 
129 
164 
130 
93 
153 


303 
243 
209 
342 
220 

246 

166 

92 


269 
236 

^ 

223 
304 
224 
251 
230 
205 
219 
129 


801 733 


FFFQ 


687 662 


Shh....::::::::::::::::. 


647 680 




754 670 


FFHQ 


618 557 
719 689 


FHHli 




565 558 


FHHO 


521 491 
659 596 


FHQQ 


HHHQ 


496 474 


HHQQ 


375 390 
311 319 




NTV^V- • 




2453 


2235 


1882 


1747 


2820 


2839 


7155 6821 
105 : 100 



In Table II, a summary of the climax and anti-climax effects 
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is given, indicating that the anti-dimax order of presentation 
is somewhat more effective as iar as memory is concerned. 

But it must be remembered that these are gross figures 
and furthermore that unequal numbers of subjects were used 
in the forward and backward turning of the pages of the 
dummy. To compensate for this the credits for each adver- 
tisement were put into percentages which were multiplied 

TABLE III 



of Adt. 


D 


A 

R Ant 


CU 


D 


B 

R Ant 


CU 


O 


R^ 


Ant CU 


PPFH 


529 
302 
270 
270 


494 
306 
312 
254 


529 
302 


494 
306 
270 
270 


218 
196 


244 

176 
252 
286 


fit 


244 

176 
201 
238 


332 
174 

248 


262 
179 
245 
318 


332 262 




174 179 
245 259 




318 248 




1397 1340 






954 


859 


1069 948 


pppQ 


286 
466 
402 
196 


268 
393 
412 
177 


286 
466 
412 

177 


268 
393 
402 
196 


202 
156 
148 
218 


218 
235 


202 

156 

92 

235 


218 
218 


275 
304 
108 
187 


280 
245 
118 
170 


275 280 




304 245 
118 108 
170 187 








1341 


1261 






685 


735 


867 820 


FPHH 


213 
275 
352 
425 


201 
296 
316 
435 


213 
275 
316 
435 


352 
425 


341 
94 


185 

185 

420 

92 






238 
61 
79 

314 


280 
121 


238 280 


HHFP 


iS ^?i 




308 314 




1239 1274 






899 


805 


735 794 


FFQQ 


89 
445 
104 
124 


102 
415 
187 
182 


89 
445 
187 
182 


102 
415 
104 
124 


235 
235 
135 
410 


J5S 

185 
512 


235 
235 
185 
512 


126 
244 
135 
410 


314 
344 
385 
126 


350 
280 
390 
163 


314 350 


QOFP 


344 280 
390 385 




163 126 








903 


745 






1167 


915 


1211 1141 


FPHQ 


298 
221 
293 
149 


244 
215 
293 
144 


298 
221 
293 
144 


244 
215 
293 
149 


106 
469 
123 
152 


42 

454 
126 
143 


106 
469 
126 
143 


42 


79 
130 
320 
199 


76 
196 


79 76 


QHFP 


130 196 
338 320 




^ m 








956 


901 






844 


771 


779 791 


PHHH 


232 
251 
340 
232 




232 
251 
264 
302 


198 
172 
340 
232 


243 

420 

74 

226 


218 

511 

59 

227 


243 

420 

59 

227 


218 

511 

74 

226 


65 
426 
381 
219 


93 
380 
315 
183 


65 93 


HHHF 


426 380 
315 381 




183 219 








1049 


942 


949 1029 


989 1073 


FQQQ 


270 

93 

119 

193 


325 

48 

134 

172 


270 
93 
134 
172 


325 

48 

119 

193 


268 
185 
304 
214 


251 
159 
362 
177 


268 
185 
362 
177 


251 
159 
304 
214 


90 
214 
158 
345 


80 
301 


90 80 


QQQP 


214 210 
224 158 




301 345 








669 


685 






992 


928 


829 793 


PHHQ 


102 

128 

193 

35 


124 

124 

234 

58 


102 

128 

234 

58 


124 
124 
193 
35 


99 
431 
259 

53 


84 
362 
285 

67 


99 
431 
285 

67 


84 
362 
259 

S3 


214 
148 
374 
126 


213 
172 
287 
159 


214 213 


QHHP 


148 172 
287 374 




159 126 








522 


476 






882 


758 


808 885 
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TABLE Ul—ConHnumi 



Order 
of Ads. 


D 


A 
R 


Ant 


CU 


D 


B 
R Ant 


CU 


D 


C 

R Ant Cli 


PHQQ 


162 
232 
361 
135 


182 
191 
403 
191 


162 
232 
403 
191 


182 
191 
351 
135 


152 
398 
119 
271 


176 
403 
143 
235 


152 
398 
143 
235 


176 
403 
119 
271 


278 

332 

187 

43 


269 

303 

242 

52 


278 269 


QQHF 


332 303 
242 187 




52 43 








988 


859 






928 


969 


904 802 


HHHQ 


279 

224 

81 

93 


258 

191 

103 

72 


279 

224 

103 

72 


258 
191 
81 
93 


66 

82 

324 

135 


33 
117 
252 
160 


66 

82 

252 

160 


33 
117 
324 
135 


231 
239 
223 
HI 


172 
213 
225 
176 


231 172 


QHHH 


239 213 
225 223 




176 111 








678 


623 






560 


609 


871 719 


HHQQ 


20 
274 


48 

220 

48 

48 


20 

274 

48 

48 


48 

220 

42 

42 


33 
292 
197 

66 


SO 
193 
135 

67 


33 
292 
135 

67 


50 
193 
197 

66 


141 
106 
300 
129 


179 

155 

273 

97 


141 179 


QQHH 


108 155 
273 301 




97 129 








390 


352 






527 


506 


619 764 


HQQQ 


35 
66 
46 
19 


57 

38 

110 

48 


35 

66 

110 

48 


57 
38 
46 
19 


74 
358 

74 
340 


42 

394 

76 

387 


74 
358 

76 
387 


42 
394 

74 
340 


65 
61 


76 

86 

128 

76 


65 76 


QQQH 


54 86 

128 234 
76 61 








259 


160 






895 


850 


323 457 



by 100 to avoid the use of decimal points. This data is pre- 
sented complete in Table III, and in summarized form in 
Table IV. Again we have a suggestion that the anti-climax 
order is somewhat more efficient than in the climax. 

TABLE IV 





Dummy A 
Anti CU 


Dummy B 
AnU CU 


Dummy C 
Anti CU 


Total 
Anti CU 


FFFH 


1397 
1341 
1239 
903 
956 
1049 
669 
522 
988 
678 
390 
259 


1340 
1261 
1274 
745 
901 
942 
685 
476 
859 
623 
352 
160 


954 
685 
899 
1167 
844 
949 
992 
882 
928 
560 
527 
895 


859 
735 
806 
915 
771 
1029 
928 
758 
969 
609 
606 
850 


1069 
867 
735 

1211 
779 
989 
829 
806 
904 
871 
619 
323 


948 
820 
794 

1141 
791 

1073 
793 
885 
802 
719 
764 
457 


3420 
2893 
2873 
3281 
2579 
2967 
2490 
2212 
2820 
2109 
1536 
1477 


3147 


FFFQ 


2816 


FFHH 


2873 


FFQQ 


2801 


FFfid;.. :::::::::::::::: 


2463 


FHHH 


3044 




2406 


FHHO 


2119 


FHQQ 


2630 


HHHQ 


1951 


HHQQ 


1622 




1467 














30677 
105: 


29339 
100 



But again a difficulty of interpretation creeps in and this 
time it comes from the sheer magnitude of the figures 
themselves. The difference between 66 and 33 for instance is 
33 or 100% ; the difference between 540 and 507 is again 33 
but only about 6%. There is to be found in the figures a dif- 
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TABLE V 
B C Total Sum Av. 



FFFH 1071 895 1268 3234 

968 1131 973 3092 

1155 1253 947 3355 

942 1201 1281 3424 



13105 3276 



FFFQ 1068 928 982 2978 

1188 1032 1241 3461 

1025 621 1092 2738 

895 1079 910 2884 

12061 3015 

FFHH 1060 978 850 2888 

930 1113 504 2547 

899 1232 1621 3752 

1022 960 983 2985 

12172 3043 

FFQQ 874 1866 897 3637 

1072 965 1228 3265 
1800 1370 1012 4182 
1469 1249 1292 4010 

15094 3774 

FFHQ 1221 2528 1040 4789 

1028 1034 664 2726 

1000 1023 1058 3081 

967 941 1165 3073 

13669 3417 

FHHH 1171 1114 700 2985 

1460 822 1121 3403 

778 798 827 2403 

1301 1004 837 3142 

11933 2963 

FQQQ 832 1069 1125 3026 

1939 1164 1020 4123 

1127 1191 1419 3737 

892 827 873 2592 

13478 3370 

FHHQ 823 1180 1005 8006 

1032 1190 861 3063 

1213 1100 767 3080 
1655 1265 1261 4181 

13352 3338 
FHQQ 889 865 1031 2785 

1214 967 1095 3296 
1150 1200 1292 3642 
1413 866 1210 3489 

13212 3303 

HHHQ 1060 2000 1342 4422 

1172 700 1122 2994 
1274 778 1010 3062 
3574 1186 1586 3546 

14024 3506 
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TABLE V—CofUifttted 
ABC Total Sum Av. 



HHQQ. 



HQQQ. 



417 


660 


788 


1865 






1245 


1510 


697 


3452 






1142 


685 


907 


2734 






1142 


1015 


750 


2907 


10958 


2739 


614 


1760 


855 


3229 






1736 


910 


629 


3275 






2390 


1028 


548 


3966 






2522 
Eiges 


1138 


1246 


4906 


15376 
1100 
1100 


3844 
3301 
1100 



Sums and Av. of Averages 



ference between the absolute amount and the relative amotuit 
of influence resulting from the changing order of presentation. 
Table of Ratios. The climax order is given an arbitrary 
value of 1,000 and the anti -climax a relative value. Since the 
climax order has always the value 1,000, it is omitted from 
the table. Table V was prepared, in which the anti-climax 
values are given in ratios, the climax order of presentation 

TABLE VI 
Anti-dimax ratios put in the form of a frequency table. 



40-59 


3 




60-79 


15 




80-99 


37 




100-119 


49 


Av. —111.11 


120-139 


23 


A.D.-. 22.67 


140-159 


6 


n —144 


160-179 


4 


P.E. — 1.6- 


180-199 


3 




200-219 


1 




220-239 


1 




240-2S9 


2 





having an arbitrary value of 1,000. This table in summary 
indicates that the anti-climax order is 10% more effective 
than the climax order, and this fact is emphasized by throw- 
ing the anti-climax values into a table of frequency as is done 
in Table VI. This method of presenting the data gives the 
anti^imax order a value of 11 + % advantage over the 
climax. The probable error is very low, only 1.6, approxi- 
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mately 1-7 of the significant diflference. It may be concluded 
then, that the anti-climax order is more effective than the 
climax order. 

GRAPH DRAWN FROM TABLE VI 
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THE SELECTION OF MILL WORKERS BY 
MENTAL TESTS. 



By Arthur S. Otis, Camp Grant, III. 



The extended use of intelligence testing in the United States 
Army has given psychology — ^niental testing in particular — a 
widespread interest. It luis come to the attention of many 
progressive industrial managers that a number of psycholog- 
ists have been engaged f pr a number of years in research in the 
making and perfecting of tests for industrial employees, 
especidly salesmen and clerks. The success of their work is 
attested to by the continued and extended use of their tests. 
The natural inference of both psychologists and industrial 
managers has been that ultimately psychological tests would be 
used to assist in choosing factory and mill workers. 

The writer was called at the close of his army service (Jan. 
1919) to the office of a large and progressive silk manufactur- 
ing company in Connecticut to install a system of mental 
tests for prospective employees," (both clerks and mill 
workers). Bringing to bear his experience in mental testing 
in the army and sdiools the writer constructed two systems 
of intelligence tests, one for clerks and executives, similar to 
the Otis General Intelligence Examination, and a comprehen- 
sive performance intelligence examination somewhat similar 
to the performance tests used in the army for foreigners and 
illiterates. This latter was for all mill workers, a large per- 
centage of whom were foreign or illiterate. 

The clerical intelligence test proved to be of decided value 
in the selection of members of the office force and has been 
adopted for permanent use. It is not the purpose of this ar- 
ticle to discuss this test. 

The results of an extended tryout of the performance intel- 
ligence examination, however, are both startling and baffling 
and cast an ominous shadow over the future of strictly intelli- 
gence tests for manual workers. 

The performance scale used in this connection consisted of 
13 tests covering a wide range of mental and manual activity. 
The examination of an individual lasted on the average an 
hour. In all some 400 employees were tested. These were 
placed in three groups according to their productive ability 
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ascertained by caieful investigation. In the last analysis it 
was found that the correlation between intelligence and pro- 
ductive ability was zero! No amount of age grouping or 
length of service grouping would bring anything but zero out 
of the correlations. 

That the tests did measure intelligence one may be perfectly 
confident, first because for the most part they were standard 
tests which have been used in one form or another for years — 
picture puzzle, drawing designs, paper folding, etc The ability 
of clerks in these tests were found to be distinctly above that 
of mill workers as a class. Secondly the intercorrelations 
between the several tests ranged between .40 and .7.S denoting 
a " reliability coefficient " for the whole scale of .97. When 
13 widely varying tests tend strongly to measure the same 
ability that ability must be " general lability " or intelligence. 

The writer is not prepared to say that it is proven con- 
clusively that there is no correlation between intelligence and 
efficiency in mill work, for various reasons. It cannot be as- 
serted confidently that every examinee did his best on the 
tests. There was lacking the incentive that is present when 
an applicant seeks emplo3mient. These examinees were already 
employed and saw no purpose in the tests. Moreover, the 
rating in productive ability was not as refined as could be 
desired due to numerous difficulties which could not be over- 
come in making the ratings. Furthermore, it was not possible 
to test such individuals as had failed to learn to weave or spin 
or be worth employing in some branch of the industry. These 
might have shown a lesser intelligence as a group. 

On the other hand the difficulties above mentioned are only 
such as would be expected to " attenuate " the correlations — 
-to reduce the true correlations to, say, one half or less. But a 
correlation must be pretty small in the first place if one half 
or one third of it equals zero! We are forced to conclude 
therefore that intelligence is a very unimportant factor in 
efficiency in silk mill work. 

The psychologist can hardly rest content with such a con- 
clusion without some sort of explanation, considering the 
known correlation between intelligence and clerical ability or 
executive ability or scholastic ability, military ability, etc. The 
following is suggested as a possible explanation. 

Firstly, the machinery of the present day is so efficient and 
automatic that vtry little intelligence is needed to use it. More- 
over, machine work is so specialized and monotonous that an 
intelligent person is very likely to revolt at it after a moderate 
period. The writer met one person who said she had sat in 
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the same chair every work day for 18 years .at her occupation 
of pasting strips of white paper around the edges of cardboard 
boxes. Yet she seemed entirely contented with the work and 
said she liked it. Some weavers had worked in the same mill 
for 35 years. Many persons do nothing but put full spools of 
silk in place of empty ones, wedc after week, year after year, 
with seeming contentment. Others do nothing but cut imper- 
fections from thread and tie the ends — ^the imperfections being 
located by electric machinery automatically. Others do nothing 
but tie knots in breaking thread. Weaving is perhaps the most 
skilled operation in the mill. The operation of a loom is prob- 
ably no more complicated than the operation of an automobile, 
yet three months are devoted to teaching a " weaver learner." 
It would seem that almost any degree of intelligence could be 
taught in that time to thread bobbins, tie knots, watch for 
imperfections, etc The man who was considered the best 
weaver in the mill, having never failed to " make bonus " for 
a long period, took something like ten minutes to assemble 
the parts of a simple J>icture puzzle of twelve square pieces 
which intelligent persons had assembled in 25 seconds, and 
he was then satisfied to leave the ear under the chin. Another 
good weaver could not put the mouth wider the nose in 25 
minutes ! 

The conclusion which the writer draws from these researches 
is that intelligence is not only not required in a modem siBc 
mill for most operations but may even be a detriment to 
steady efficient routine work. What qualities are required 
remain to be sought. Whether they are measurable is doubt- 
ful. They may be stolidity, patience, inertia of attention, 
r^fularity of habits, etc. 

The field of industrial psychology as applied to manual labor 
is believed by the writer to be virgin soil. 
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THE COMMON SYNAESTHESIA OF MUSIC 



By £. Leigh Mudge, State Normal School, Edinboro, Pa. 



Synaesthesia, the reaction of one sense to the adequate 
stimulus of another sense, is not so unccMnmon as is often 
supposed. It is true that the very noticeable types commonly 
described are relatively rare, though even these are found by 
a recent writer to appear in frcwn 9 to 15 per cent, of adults 
and in 25 per cent, of ^olescents.^ Like most tendencies in 
nature, synaesthesia appears in many degrees of variation. It 
is not a clearly-cut type of abnormality. It is, in fact, too 
common to be called an abnormality at all. Like any tendency, 
it is foimd in abnormal and extreme cases, but it has no 
absolutely definable lower limit. It is theoretically doubtful if 
any sense reaction takes place in absolute isolation from other 
senses. In the case of any meaningful experience of vision 
or audition, sight or hearing js the key that unlocks a OMn- 
plex of sensations or images or both in terms of a variety of 
senses, especially the deep-seated organic and strain senses 
and others intimately involved in feeling and emotive 
processes. 

Doubtless there is a closer connection between either vision 
or audition and the deep-seated intimate senses than between 
these two articulative senses themselves. However, it is not 
strange if there be some tendency, with individual variations, 
to connect visual limagery with auditory stimuli. Various un- 
usual cases of " colored hearing " and other inter-associations 
of vision with hearing have been reported. Rq>orts irom 
fifty mature students, chiefly active public school teachers, 
seem to indicate that the unusual cases represent an imcom- 
mon development of a common tendency. These fifty students 
were asked to report the colors or brightnesses which they 
associate with certain tones, keys, instruments, and familiar 
musical compositions. Only eight reported a total lade of 
such associations. While there is little uniformity as to par- 
ticular color associations, some tentative generalizations appear 
warranted by these reports. 

* Wheeler, Rasmiond H., The Synaesthesia of a Blind Subject, 
University of Oregon Publications, Vol. I, No. 5, May, 1920, p. 32. 
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1. A low tone. Thirty- four persons associate low tones 
with dark colors or grays. Fourteen associate no cdor or 
brightness with low tones. One associates with medium gray, 
and another with *' rich colors." 

2. A tone of medium pitch. There is no uniformity of 
color here, but a generally uniform medium brightness in 26 
cases. The remaining 24 discover no such association. 

3. A high toiie. This is associated in all but 14 cases with 
bright colors or light grays?. There is a wide variety of color 
associations. 

4. The key of C. Twenty persons report a color or bright- 
ness associated with ithis key, eight of these associating it with 
blue. The dominant association, however, seems to be with 
medium brightness, which may be attributed to the conunon- 
ness of this key in music and the medium range of composi- 
tions. 

5. The key of A. Only nine persons mention color asso- 
cations with this key, and these vary from blue to yellow. 

6. Key of D minor. Fifteen "persons associate this key 
with dull or soft colors, as pale green, lavender, or violet, and 
with grays. 

7. Key of A flat. Only ten report visual associations and 
these show no uniformity. 

8. The piano. Twenty-four persons associate the piano 
with colors or brightnesses, but there is no observable uni- 
formity. The piano may perhaps represent a great variety 
of imagery according to key, pitch, etc. 

9. The violin. Only fifteen Jiave no color or brightness 
imagery associated with the violin. To nearly all the remain- 
ing 35 it suggests delicate colors, predominantly blue, violet, 
and related colors. In one case there was a traceable associa- 
tion between brightness or delicate color and the light dresses 
of violinists heard at Chautauqua. 

10. The pipe organ. Nineteen have no color or brightness 
association with the organ. Most of the remainder associate 
it with dark values, brown being the one most frequently 
mentioned. 

11. The clarinet suggests to 19 persons colors of high 
brightness value, but has no such association for the remaining 
31. 

12. The trombone. Fourteen reports associate this instru- 
ment with dark colors or yellow, with brown predominant. 
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13. The cello. In 19 reports the browns and reds pre- 
dominate, perhaps due, in some degree, to association with 
the color of the instruement. 

14. The snare drum. Twenty persons report an imagery 
usually of bright colors or gray. In four cases there is a 
mixture of colors or brightnesses. 

15. The bass drum. Twenty-eight persons report an 
imagery chiefly of low brightness values. 

16. The flute. To twenty-four persons the flute suggests 
colors of high brightness values, or white. 

17. Dvorak's Humoreske. A large proportion of the stu- 
dents have color association with this familiar composition, 
but there is no uniformity. Some appear to distinguish differ- 
ent color or brightness imagery corresponding to the very dis- 
tinct moods of the piece. 

18. Mendelssohn's Spring Song is rather naturally asso- 
ciated with spring colors, greens, pinks, etc., in 33 cases. 

19. Chopin's Funeral March is associated by 32 persons 
with dark shades and such colors as blue, violet, and lavender. 
The use of lavender, as well as black and grey, in funeral dec- 
oration should be noted. 

20. The Star Spangled Banner could with difficulty be dis- 
sociated from the colors of the flag itself. However, 26 per- 
sons associate it with single colors, chiefly red and yellow. 

21. Annie Laurie suggests to 27 people soft and relatively 
dull colors, 17 of them mentioning blue or g^reen. 

22. The Soldierjf Chorus from Faust is associated in the 
experience of 22 persons with bright colors, red and blue 
being predominant. 

23. The Pilgrims' Chorus from Tannhauser suggests 
medium or dark colors or brightnesses to 17 people. 

24. A lively march suggests red to 19 persons and other 
colors to 10 more. 

25. A dreamy waits has color or brightness associations 
for 29 persons, chiefly the softer colors of relatively high 
brightness, as light blue, pale yellow, pale pink. 

It is clear that much, perhaps most, of the visual imagery 
aroused by musical selections or even by given musical instru- 
ments is derived from particular experiences and associated 
circumstances. Such imagery is apt to be very complicated 
and shifting, and hence anything like Scriabin's " colored sym- 
phony" involves immense, perhaps insuperable, difficulties. 
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There are, however, certain observable tendencies to uniform- 
ity, whatever their origin may have been. A high t<me or a 
high pitched instrument is generally associated with bright 
colors or lighter grays, while a low tone or a commonly low 
pitched instnunent suggests dark color and brightness indues. 
There appears also to be a relation between the timbre of an 
instrument and the richness of color associated with its tone. 
Although there is a wide variation of color-imagery, it is prol>- 
aWe that the common term " tone-color " is not a mere figure 
of speech based upon analogy. A tone which approaches a 
" pure " tone is described by musicians as " white or color- 
less," It is probably not a Imere musician's whim that com- 
monly associates complexity of tone with the visual richness 
of color. 
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A COMPARISON OF TWO METHODS OF GIVING 
THE NUMBER SERIES COMPLETION TEST. 



John E. Anderson, Yale University 



Incidental to an investigation upon intelligence tests with 
Yale Freshmen a comparison was made of the cross-out 
method as developed by Pressey* and the completion method 
as used in the army of giving Alpha Test 6, the number series 
completion test. 

The cross-out test was constructed by taking Test 6 Alpha 
Form 9, completing each series and inserting a number not 
in the series in each row in such a way that at first glance it 
might appear part of the series. The subjects were given 
instructions to cross out the nimiber in each row which did 
not belong in the series. The Test 6 Alpha instructions and 
examples were paraphrased to fit the cross-out method, being 
kept as nearly as possible in the original form. 

A preliminary examination of 14 subjects demonstrated that 
the Alpha Test 6 time limit of 3 minutes was much too brief 
for the cross-out method and resulted in the selection of 7 
minutes as the time limit. 

Eighty-five subjects were used, obtained by requesting the 
men of three divisions of a required subject to report for a 
second examination which consisted of the cross-out test 
among several others. These men had previously taken Alpha 
Form 6 with the tentire group of Yale College Freshmen.* An 
interval of seven months elapsed between the two examina- 
tions. 

The results are as follows: 

Time Range Mean Standard 

Limit Deviation 

Gmipletion Method 3min8. 5-20 13.5 2.7 

Cro68-Out Method 7min8. 4-20 12.7 3.4 

Although the time limits differ to a considerable extent, the 
two methods of giving the test result in practically the same 
range, mean, and standard deviation. 

1 Pre«scy, S. L. and Prcssey, L. W. Journal of Applied Psychology, 
Vol. Ill, 1919, p 138-150. 
* Anderson, J. E., School and Society, Vol. XI, 1920, pp. 417-20. 
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Correlation coefficients were obtained by the product 
moment method between the average collie standing of the 
men for the entire Freshman year's work and the test scores.- 
These arc as follows : 

r. P. E. 

College standing and Cro68-out +25 d:.07 

College standing and Comi^etion +.04 ±.07 

Completion andCroesKnit +.44 ±.06 

Alpha score and Coll^ie Standing +.25 ±.07 

Alpha aooce (with cro68-out scores substituted for com- 

pletkm scores) and College Standing +.34 ±.06 

Unfortunately I have no measure of the reliability of either 
of the methods because the tests were not repeated. But the 
coefficient of correlation between the completion method and 
the cross-out method of giving the test is low enough to 
indicate that the change in the method of administration results 
in a distinct test, different from the original, a conclusion 
borne out by the other {coefficients. While the cross-out 
method correlates to some extent with college standing the 
completion method does not. The effect of substituting cross- 
out scores for completion scores in Alpha is shown by the 
increase in the resultant coefficient for total score with cdlege 
standing from 25 to .34. 

The evidence from 85 cases of Yale Freshmen is that the 
cross-out method of giving the number series completion test 
is superior to the regular completion method as measured by 
the criterion of correlation with collie standing. 
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THE APPLIED PSYCHOLOGY OF NAMES 



By A A. RoBACK^ Harvard University, 
Assisted by Marie Gboetzinger 



1. Nature of the Problem 

Though the field of memory has been traversed carefully 
by so many painstaking investigators since the days of Ebbing- 
haus, new problems have come up through channels which 
until recently had not been amenable to the scrutiny of general 
psychology. The practical demands of applied psydiology 
opened the way for many a new problem ; and as is f requenfly 
the case, the results gained in the practical sphere may oflfer 
some suggestions as regards the theoretical aspects of memory. 

In our present commercial system, it is l>wx>ming increas- 
ingly common to see firms consisting of two or more partners, 
which often necessitates their names being arranged in a cer- 
tain combination. Usually what determines the precedence 
of one name over another is the seniority of one of the 
partners. But it is not always that a firm can claim a senior 
partner. Suppose two men agreed to enter into a business 
relationship with the same capital and with equal privileges 
and liabilities. The question before us then is: is there any 
general rule that can be applied as to the way the combination 
of their names should appear in advertisements, on letter-heads 
or in any form of publicity? If Smith and Stanft were to start 
business together, would rt be more advantageous to have the 
names stand as they were just mentioned, or would it be more 
advisable to reverse the order and call the firm Stanft and 
Smith? It will readily be perceived that the issue is one be- 
tween familiarity and unf amiliarity, since in most situations of 
that sort, one name is not so familiar as the other. There are, 
to be sure, other diflFerences between names, but that of 
familiarity or unfamiliarity seems to be the most comprehen- 
sive, embracing even the length element of the name. We 
often hear people say " Oh, I can't think of the name. It's such 
an uncommon name." The memory lapse is thus directly 
ascribed to unfamiliarity. 

Were it merely a matter of settling the question whether 
familiar names are more easily remembered than unfamiliar 
ones, experiments would scarely be neccessary. The princi- 

348 
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pie of association implies this result unmistakably, and in prac- 
tically every memory investigation there arc indications of the 
greater mnemonic value in the case of the more familiar 
material.^ 

In confining our problem to the study of combinations con- 
sisting of familiar and unfamiliar names, we have a definite 
task to perform, since no information is as yet available on 
this phase of memory, and in default of such knowledge, busi- 
ness men who are confronted with the situation referred to 
above, will decide the question a priori or perhaps by tossing 
a coin — methods which are not permissible in either science 
or business. 

In the course of the investigation, a new item presented itself 
for further inquiry, viz, the fact that repetition oflfers a greater 
gain in eflfective value for unfamiliar names than it does for 
familiar ones. This apparent result prompted another set of 
experiments in order to ascertain whether the gain is sub- 
stantial enough to make up for mnemonic difficulty going with 
unfamiliarity. For theoretical purposes, the bare result would 
be important in itself, but the practical side of the problem 
thus becomes encumbered by another situational factor, so that 
if it is established that the one type of combination has an 
advantage over the other, the question may be asked: after 
how many exposures ? It may be that after the first repetition, 
the name " Cui '* has a better chance for reproduction than 
such a common name as Smith or Jones but that subsequently, 
cither on account of the many associative inhibitions occurring 
with the latter or else because of the disproportionate distri- 
bution of attention, the name " Cui " would actually be the 
one to be recalled more easily in connection with a given firm.* 

That the applied psychology of names is no minor factor in 
business can be inferred from the fact that so many aliens and 
Americans of foreign descent find it expedient either to change 

^ It must be noted that a common name and a familiar name are not 
interchangeable terms. An uncommon name may become familiar 
tiirough some political event or because of the rise to popularity of 
some theatre (movie) star. Such accidents will of course, to a con- 
siderable extent, affect the degree of familiarity or unfamiliarity of 
a name without appreciably reducing its uncommonness. Contingen- 
cies of this sort cannot enter into our problem, Ihough they doubtlessly 
have a decided bearing on our memory function. 

2 The repression of certain names on Freudian principles, if at all 
operative, is altogether too individual an occurrence to render it worthy 
of consideration in this connection. Should we accept ^e extreme 
view that every memory lapse is symptomatic of a repression, tiie 
whole of the psychology of memory would reduce to a speculative 
psychoanalysis barren of the least predictability. 
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their names entirely or else modify them in some way as to 
conform to the general vogue of names: the "owitz" or 
" sky " termination in Slavic names is frequently dropped ; the 
Umtaut and duplication of letters so common in German names 
are often done away with, and in general there is a tendency 
to adapt the name to suit the native taste. Most foreigners 
who enter an application for such dianges state explicitly that 
it is a business measure ; and they seem to be satisfied with the 
results. 

The subject is not devoid of its ethical and legal aspects. 
It may be questioned whether one with a true sense of family 
pride would assume another name. Still more may it be dis- 
puted whether it is commendable to give up from practical 
motives the most conspicuous ancestral heritage. When we 
note the persistent adherence of the Savages, the Cowards, the 
Hoggs, the Butchers, the Swindles and the Coffins to their ill- 
sounding, but at the same time significant, patron3miics, we 
cannot but admire their loyalty to their predecessors as well 
as their independence in maintaining their familial identity 
unbroken. 

Happily our investigaticMi is not concerned with moral issues 
nor is it called upon to consider personal whims or tastes or 
the domineering influence of one partner over the other in 
the matter of name combinations. We shall assume, on our 
side, that the only factor which is to determine the arrange- 
ment of the pamters' names is to be that of promoting their 
several business interests; and within that compass, our 
problems lends itself to a clear-cut treatment. 

The practice of adopting impersonal trade names, such as 
is a necessity with corporations, will at once su^fest itself as 
a welcome compromise whenever there is a question that is 
likely to become serious as to the priority of a particular name. 
There are indeed numerous lines of business which favor the 
imperscMial trade name. A garage, for obvious reasons, will 
almost invariably be known by its locality. Similarly we are 
accustomed to such signs as The City Coal Co., The National 
Tea Co., The United States Tire Co., The New York Paper 
Co., ITie College Bindery, etc etc. Manufacturers of novelties 
and even standard articles are especially apt to link their wares 
in the minds of the public with an impersonal s)mibol sug- 
gestive of (in many cases inappropriate to) the particular 
article. The marketable value of this symbol as a brand or 
trademark or label has been so much emphasized in books 
on advertising that the mere mention of it here as bearing a 
tangential relation to our problem is sufficient. 
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It will readily be conceded that the personal name is still 
in vogue among most firms and particularly in certain lines of 
merchandise, where the adoption of a patented trademark does 
not prevent the merchants from identifying themselves in con- 
nection with the wares. 



2, Method of Procedure 

The experiments to be reported were carried on in the 
Psychological Laboratory of the University of Pittsburgh dur- 
ing both semesters of 1917-18. The subjects were two instruc- 
tors in the department of psydiology, and one woman student, 
with considerable training in psychology. 

Apparatus. The apparatus consisted of a k3miograph and 
two screens. The larger screen was made of blade card board 
with an opening 2yi X 2 inches. The smaller screen was 
made of tin, painted black, and curved to fit the kymograph 
drum. The openuig in the second screen (2^ X /4 indies,) 
was large enough to expose one stimulus at a time from ttit 
list revolving on the kymograph drum. 

Material. Familiar and unfamiliar names were used in 
single columns and in combinations of (a) familiar with 
unfamiliar, and (b) unfamiliar with familiar. The names 
were arranged and grouped as follows : 

1. 20 Monoeyllabic familiar 
20 monosyllabic unfomiliar 

2. 20 dissyllabic familiar 

20 dissyllabic unfamiliar 

3. 15 monosyllabic familiar with un&miiliar 
15 monoeyllabic unfamiliar with familiar 

4. 15 dissyllabic familiar with unfamiliar 
15 dissyllabic unfamiliar with familiar 

5. 10 trisyllabic familiar with unfamiliar 
10 trisyllabic unfamiliar with familiar 

Examples of familiar names — Brown, Dixon, Foster, Wal- 
lace, Matthews, etc. 

Examples of unfamiliar — Farquhar, Martinez, Swoboda, 
Enza, etc. 

Six, or eight lists of names were given at each sitting, the 
number varying on account of the difference in the length and 
the complexity of the lists. 

At each sitting the lists of the single names were given first, 
followed by the lists of combination, i. e. beginning with 
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the simpler names and then going to the more complex com- 
bination. The subject read doud each stimulus as he saw it. 
When the list was complete he would write down as many 
of the combinations and single components of the combina- 
tions as he could remember. 

During the first semester one review of the list was given, 
but during the seccmd semester two reviews were given of each 
list so as to test whether there was any tendency to remember 
the unfamiliar names better after repetition than the familiar 
names. In this way the subject at each sitting got some lists 
that were entirely new while others he merely had to review. 

It was rather difficult to get names that all the subjects would 
regard as either decidedly familiar or unfamiliar The aim 
of the experimenter was of course to eliminate all indefinite 
cases, though this was not possible at all times. Local differ- 
ences naturally cannot but enter into the determination of the 
degree of familiarity. Thus a name like Shanahan would be 
considered familiar in Pittsburgh though elsewhere it might 
not be so regarded. 

It took fifty seconds to expose a list of single names and 
one minute to expose a list of paired names. All of the names 
were typewritten on long sheets of paper so as to fit around 
the kymograph drum. 

One of the subjects required a double exposure of each list 
in order to reproduce at least several of the names. 

The first day the series of single familiar names was exposed 
before the unfamiliar names. The same procedure was gone 
through with the names in combination — ^the familiar-unfa- 
miliar combination being given before the imfamiliar-familiar. 
At the second sitting, however, this order was reversed and 
the unfamiliar names were exposed first. This alternating 
method was used throughout the experiment in order to elim- 
inate the well known factor of primacy, according to whidi 
the first elements are remembered better than the succeeding 
ones. 

Key to Tables 

The tables for the monosyllabic, dissyllabic and trisyllabic 
combinations give in separate columns the total percentage 
both for the combination as well as for the separate single com- 
ponents i. e. either the familiar or the unfamiliar element 
remembered. 

After repetition there is always a gain as may easily be 
expected, but in one or two cases, curiously enough, a loss is 
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shown, in which case the numbers are preceded by a minus 
sign. 

There were no third trials given during the first semester, 
which explains why the results for the first and second trials 
are based on so many more combinations than the results for 
the third trials. 

During the first semester two weeks intervened between suc- 
cessive trials, but during the second semester the interval was 
reduced to one week. 



Total percent 
diwyUabiciiam 



tt.of 1 



TABLE No. 1 
( remembered out of 360 nngle monoeyUabic and 120 aiiifflfr 





No. of 
StinraU 


PirttTHal 


Second Trial 




Familiar 


Unfamiliar 


Familiar 


Unfiuniliar 


Total percent of names re- 
erUabicnnfieeeriet 


360 


61% 


35% 


54% 


41% 


Total percent, for the disyl- 
labic tincle eeriet 


120 


42% 


24% 


42% 


26% 






Total percent for the mono- 
nrUaUc and dinyllabic 


480 


46.5% 


29.5% 


48% 


33.5% 







Note on Table 1. 

This table shows the total percent, remembered out of 
360 single monosyllabic and 120 dissyllabic names. As would 
be expected, during the first trial there were more familiar 
names remembered than unfamiliar; and in the second trial 
there was the natural increase in every case except the dis- 
syllabic familiar, due perhaps to distraction on the part of 
one of the subjects in this particular trial. These resvUts also 
reveal the fact that the unfamiliar names show a greater 
percentile gain in the second trial over the first than do the 
familiar ones. In the monosyllabic names there was a gain 
of 6% in the unfamiliar while in the familiar series there was 
a gain of only 3%. Furthermore, the gain for the unfamiliar 
dissyllabic names was 2% while the familiar dissyllabic names 
showed no gain. This general tendency appears likewise in 
the total percentage of the combined monosyllabic and dis- 
syllabic lists. 
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TABLE No. 2 
Total percent, of names remembered out of 90 monosyllabie names in combination. 





No. 

Stim- 
ttli 


First Trial | 


Second Trial 




Pamiliar~ 
Unfamiliar 


Unfamiliar- 
Familiar 


FamiUar— 

Unfamiliar 


Familiar 




C 


F 


U 


C 


F 


U 


C 


F 


U 


C 


F 


U 


Total percent, 
lor MoiioayUa- 
bic Combina- 
tion 


90 


22% 


4.4% 


8% 


21% 


9% 


4.4% 


30% 


5.5% 


16% 


22% 


10% 


5.5% 




Gain of second 
trial over first 
trial 
















8% 


1.1% 


2% 


1% 


1% 


1.1% 





Note on Table 2 

This table gives the total percent of names remembered in 
combinations of monosyllabic familiar and unfamiliar names 
such as Smith and Knaus, Tsolt and Hughes. The gain of 
tlie second trial over the first in these combinations is also 
given. 

In both the first and second trials there were more familiar- 
unfamiliar combinations remembered than unfamiliar-familiar 
ones. As is shown in the gain of the second trial over the 
first, the unfamiliar half of the combination benefits more by 
the repetition than the familiar half. 



TABLE No. 3 
of 540 dissyllabic names. 




Finl Trial 




No. of 

Stimuli 


Familiar- 
Unfamiliar 


Unfamiliar- 
Familiar 






C 


F 


U 


C 


F 


U 


Total % for dis- 
syllabic combina- 


540 


17.3% 


10.4% 


4.4% 


14,9% 


14.7% 


4.9% 






Gain or loss of 
second trial over 
first trial 
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S^OHd Trial 




r&.s& 


Familiar- 
Unfamiliar 


Unfamiliar^ 
Familiar 






C 


F 


U 


C 


F 


U 


2S?<SJ&as:: 


640 


10.4% 


8.9% 


10.7% 


17.1% 


15.3% 


7.8% 


Gain or Iom of wc- 
ODd trial over first 
trial 




6.9% 


1.6% 


6.3% 


2.2% 


.6% 


2.9% 







Note on Table 3. 

This table gives the total percent, of names remembered 
after the first and second trials of the dissyllabic oxnbinations 
of 540 names, and also llie gain or loss in the second trial 
over the first. There was a gain in every case, which naturally 
was to be expected, except in the case of the whole combina- 
tion in the familiar-mif amiliar list which shows a loss of 6.9%. 
This loss however, is to be considered together with the gain 
in the familiar and unfamiliar separate names which formed 
part of the combination, so that in reality the loss was much 
slighter; and if we give unit values to the combination and 
half values to each separate component (of the combination) 
then the loss for that series would be only 3%. This loss, 
which seems peculiar, may be explained by the physical condi- 
tion of one subject — ^at least there is a note to that effect in 
the protocol. 

In the first trial there is a greater percent, of names remem- 
bered in the familiar-unfamiliar combination than in the 
unfamiliar-familiar. However, this is reversed in the second 
trial where there were 17.3% remembered in the tmfamiliar- 
familiar combination over against only 10.4% in the familiar- 
unfamiliar combination. This result is not incompatible with 
the first result, i. e. that the familiar-unfamiliar combination 
is more favorable for remembering than the unfamiliar-fami- 
liar, but is rather in accord with what has afterwards been 
found to be the case in regard to the eflfect of repetition on 
the familiar names as compared with the unfamiliar names. 

This table also shows a greater gain in the second trial of 
the unfamiliar over the familiar, since in both types of combi- 
nations (the familiar-unfamiliar and the unfamiliar- familiar) 
the unfamiliar components showed in the second trial a much 
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greater gain than the familiar components, viz. 6.3% and 2.9% 
as against 1.5% and .6%. 

TABLE No. 4 

Total percent, of names rem em bered after the first and aeoood triala of the oombina- 
tiooa of 60 iritylUbk names. 



FirttTriml 





No. of 
Stimnli 


Pamfliar^ 
Unfamiliar 


Unfamiliar- 
Familiar 






C 


F 


U 


C 


F 


U 


Total percent, for the tri- 
STllabic Combinatioos. 


60 


11.6% 


20% 


10% 


20% 


13.3% 


15% 


Total lucent, for the tri- 

Gam of second trial over 
firsCnsing only two 


40 


10% 


25% 


5% 


12.5% 


20% 


15% 


* 





Second TrM 





No. of 
Stimuli 


Pamiliar- 
Unfomiliar 


UnfomOiar- 
FamiUar 






C 


F 


U 


C 


F 


U 


Total percent, for the 
trisyllabic combin- 
ations 


60 


25% 


13.3% 


11.6% 


21.6% 


23.3% 


15% 






Gain of second trial 
over first trial 




13.4% 


-6.8% 


1.6% 


1.6% 


10% 





Total percent, for the 
trisyllabic combin- 
ations of two sub- 
jects 


40 


20% 


20% 


7.5% 


20% 


30% 


12% 






Gain of second trial 
over first, udng 
only two subjects.. 




10% 


-.5% 


2.5% 


7.5% 


10% 


-.3% 



Note on Table 4. 

This table giving the total percent, of names remembered 
out of a series of 60 trisyllabic names in combination such aa 
Richardson and Boyarjan was inserted only lor the sake of 
completeness. As a matter of fact its value may be questioned 
not only because the number of stimuli was insufficient to 
warrant any iconclusion but also for the reason that some 
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of these names which were thought to be unfamiliar by the 
experimenter were really familiar to one of the subjects. 
This is the only series in which there is no corrdation apparent 
between the arrangement of the combination and its memory 
value, even after eliminating the results of the one subject 
whose acquaintance with a certain class of names proved to be 
a disturbing factor. 



Total percent, of i 



TABLE No. 5 
I remembered after the third triml of the combination of 180 



diMjrllabic names. 


















No. of 
Stimuli 


Familiar-Unfamiliar 


Unfamiliar-Familiar 






C 


F 


U 


C 


F 


U 


Total percent, for 
the third trial 
diityllabic oom- 
binationt. .... 


ISO 


21.6% 


8.3% 


11.1% 


18.7% 


17.2% 


13.8% 


Gain or loee of 
of third trial 
over first trial . . 


180 


3.3% 


-2.1% 


6.7% 


3.8% 


2.5% 


8.9% 


Gain or lose of 
third trial over 
second 


180 


10.2% 


- .6% 


.4% 


8.3% 


1.9% 


6% 







Note on Table 5. 

This table gives the total percent, for the third trial of ithe 
dissyllabic combination of 180 names and also the gain or loss 
over the first and second trials. 

These results show the natural increase over the first and 
second trials. The only place showing a loss is in the familiar 
column of the familiar-unfamiliar combination. This loss 
however, is very slight and is Imade up for by the gain in the 
other columns. Giving unit values to the complete combina- 
tion and half values to the separate components, there is a total 
gain of 10.1%. 

In every case the unfamiliar names show a greater gain 
upon repetition than the familiar ones. 

Note on Table 6. 

This table gives the total percent, of names remembered 
after the third trial of the trisyllabic combinations of 60 
names, and also the gain or loss of the third trial over the first 
and second trials. The results are the same as in table 5 
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Total pereeat. of i 
trisjrllabici 



TABLE No. 6 
I remembered after the ikiri trM of the combmatkm of 60 







Pamiliar-UnfamiUar 


Unfamiliar-Familiar 




No. of 
StiffluU 


C 


F 


U 


C 


F 


U 


Total percent, for 
third trial of tri- 
•yllabic combina- 


eo 


31.6% 


16% 


21.6% 


25% 


21.6% 


28.3% 






Gain or loat of thiid 
trial over first. . . . 


GO 


20% 


—5% 


11.6% 


5% 


8.3% 


13.3% 


Gain or Iom of third 
trial over aeoond.. 


GO 


6.6% 


1.7% 


6% 


4.4% 


-1.7% 


13.3% 



in that the familiar-unfamiliar combination is favored to 
begin with, but after repetition, the unfamiliar components of 
boih the familiar-unfamiliar and unfamiliar-familiar combi- 
nations show a greater mnemonic gain than the familiar com- 
ponents. 

Note on Table 7. 

This table gives the total percent for all the series of com- 
bined names, thus showing the relation between the familiar- 
unfamiliar and unfamiliar-familiar combinations. The third 
trial concerns only the combination of 180 dissyllabic names 
and 60 trisyllabic names, since no third trials were given for 
the monosyllabic combinations. In the first and second trials 

TABLE No. 7 
Total percent, of names remembered for «U tk4 a€fU$ of 



Fff f 1 Trial 




No. of 
Stimuli 


FamiUar- 


Unfamiliar- 
Familiar 






C 


F 


U 


C 


F 


U 


Total percent, for all 
series of combina- 
tions 


690 


16.9% 


11.6% 


7.5% 


18.9% 


12.3% 


8.1% 






Total percent, count- 
ing combinations as 
1, and single com- 
ponents as H 


690 


26.4% 


29.05% 
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S4C9md Trimi 












No. of 
Stimuli 


Pamiliar- 
Unlamiliar 


UnfamiUar- 
Pamiliar 






C 


F 


U 


C 


P 


U 


Total percent, for aU 
■eries of oonbim* 
tiom 


690 


21.8% 


9.2% 


10.4% 


20.2% 


16.2% 


9.4% 




Total percent, count- 
as 1. and tiiule 
components asHi . . 


690 


31.7% 


33% 







Tkir4 Triml 












No. of 
StimuU 


Pamihar- 


Unfamiliar- 
Familiar 






C 


p 


U 


C 


P 


U 


Total percent, for aU 
series of combtna- 
tions 


240 


26.6% 


11.6% 


16.3% 


21.8% 


19.4% 


21% 




Total per cent, 
counting corabin- 
ations as 1. and 

sin^oomponenu 


240 


iO so% 


42% 

















the results are taken from 690 combinations of monosyllabic, 
dissyllabic, and trisyllabic names, but in the third trial the 
results concern only the combination of 240 dissyllabic and tri- 
syllabic names. These results might seem to reveal a slight 
preference for the familiar-unfamiliar combination over the 
unfamiliar-familiar. However, by giving unit values to the 
whole combination and half values to each of the familiar 
and unfamiliar components, it becomes evident that the 
unfamiliar-familiar combination is favored, due to the greater 
number of single unfamiliar components remembered as com- 
pared with the single familiar components. ) 
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TABLE No. 8 
Total aain 0f lou for aU the teriet of oombiiied namet. 





Familiar-Unfamiliar 






C 


F 


U 


C 


F 


U 


Total gain or lots of aecond 
trial of oombinatioQ aetkt 
over tot trial 


4.9% 


—2.4% 


3.2% 


1.3% 


3.9% 


1.3% 






Total nin of thiid trial of 
oomUnatioD aeriea ova- 


9.7% 


.05% 


8.85% 


2.95% 


7.1% 


12.95% 






Total ndn pf third trial of 
oommoatioo over aeoond 
trial 


4.8% 


2.45% 


5.65% 


1.65% 


3.2% 


10.65% 







Note on Table 8. 

This table shows the relation between the gain or loss of 
the second trial over the first, the third trial over the first trial 
and the third trial over the second ; and the relation between 
the gain in the unfamiliar as over against the familiar. In 
every case the gain after repetition is greater in the unfamiliar 
than in the familiar column. 

Conclusion 

The above results tend to prove (1) that a combination of 
names possesses a greater immediate memory value if the more 
familiar component of the combination appears last, and the 
less familiar first; (2) Other things equal, the unfamiliar ele- 
ment shows a greater memory gain than the familiar com- 
ponent — which sugests that in time, that is to say, after 
a large number of repetitions, the former iwill become a more 
effective stimulus than the latter. 
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INTELLIGENCE TESTS AND ACADEMIC STANDING 



Edna Gokoon tnd H. J. Bakes, University of Michigan 

Conmimiicated by W. B. Pillsbuky, Professor of Psychology, 

University of Michigan 



According to the survey made by Miss Caldwdl^ there is 
not much evidence for a close correlation between the results 
of mental tests and college grades, the range in coefficients 
of correlation between diese two factors, including Miss 
Caldwell's own experiment is from .09 to .44. 

The following report adds no conclusive evidence to that 
already obtained by others, but the results given here cor- 
respond somewhat to those obtained by Miss Caldwell. 

As a part of the course in the study of mental tests, forty- 
four students in an elementary course in Psychology were 
given the Stanford Revision of the Binet-Intelligence Tests 
XIV, XVI (Average Adult), XVIII (Superior Adult). 

The majority of the students were sophomores, the remain- 
der upperclassmen in the University. The average chrono- 
logical age was twenty-one years, three months; mental age, 
^>proximately seventeen years, ten months. The range in 
intelligent quotients was 91 to 119, average 111. 

The grades of these students in the various subjects pur- 
sued were obtained from the Registrar's office. Using the 
ratio of hours to honor points, (a C grade in a four-hour course 
gives four points, B grade, eight points, A grade, twdve 
points, D grade no points) a general ratio was obtained for 
each student in all subjects, and in each group of subjects as 
follows: Languages, Rhetoric and English, History, Philoso- 
phy, Political Science, Political Economy and Sociology, 
Oratory and Fine Arts, Mathematics, Physics and Chemistry, 
Other Sciences. 

The coefficient of correlation, Pearson formula, was 
obtained between the I.Q. and the general ratio (hour-honor 

^ Helen Htibbert Caldwell, ''Adult Tests of Stanford Revision 
Applied to College Students." Jour, Educational Psychology, Dec. 
19l5. 
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points) for the group in all subjects; and for each group of 
subjects as shown in the following table: 

I. Q. Correlated With 

General Ratio 446 

Pditical Ec.— Soc 548 

Other Sciences 537 

Rhetoric— English 481 

Mathematics 450 

Oratory— Fine Arts 354 

Phydcs-^Chemistry 334 

Languages. 229 

Philosophy 096 

History 047 

Political Science 017 



Pkt)bable Error 


Le8sthanr/5 




• r/5 




' r/5 




' r/5 




' r/4 




'• r/2 


« 


' r/3 


" r/3 


Greater than r 



It will be noted that the probable error is so large in the 
last three cases that no significance can be attached to the 
results; in fact, in all the coefficients of correlation given in 
the above table, it must be borne in mind that the number 
of students and the number of hours represented in the dif- 
ferent subjects were widely variable. Therefore no attempt 
will be made to draw condusions save the very general one, 
that on the whole there is a slight positive correlation be- 
tween the results of this intelligence test and academic stand- 
ings, and that further and more extended investigation is 
needed before one can definitely state what the relationship 
is between these two factors. 

In addition to the college students, twenty-four students in 
a short term course in Public Health Nursing were given tests. 
The coefficient of correlation between the intelligence quotients 
and the grades in psychology is .50. The following summer 
a second group of twelve nurses were tested by another class 
and a co^cient of correlation of .21 obtained between intelli- 
gence quotients and grades in psychology. A third group of 
eighteen nurses were tested during the first semester of this 
year, and a coefficient of correlation of — .187 was obtained. 
Owing to some difficulty and misunderstanding in the admin- 
istrative offices, we were unable to obtain the records of the 
nurses in other courses. 

The last two correlations we consider of little value, be- 
cause of the small number of cases, and althou|^ the first 
coefficient, .50, does seem significant, we cannot place as much 
confidence in the results of the tests given the nurses as in 
the results obtained from testing the regular students. In 
first place, the nurses were of widely varying education and 
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experience, some being middle aged, with no high-school 
training; others were high-school graduates and had but 
recently finished their nurse's training. The regular coll^^ 
students, on the other hand, were practically of Sie same age 
and experience. (Then too, the inexperience of the exam- 
iners may account in some measure for the apparent dis- 
crepancy in results.) The college students were all tested 
by three persons who had previous experience in giving tests. 
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A DECISION STUDY OF 150 YOUNG MEN AND 
WOMEN 



By Sybil Marsh Gibson 



1. Description of the Test 

The following study was undertaken in the Harvard Psydio- 
logical Laboratory in 1915 with the purpose of standardizing 
a decision test for use with psychopathic and defective cases. 
In the search for norms with which to compare the perform- 
ances of such cases, comparative data from normal individuals, 
men and women, were obtained, and these are presented here 
as having interest in themselves. 

The aim was to have a series of decisions of graded diffi- 
culty and of uniform difficulty within a pven grade so that 
some idea might be obtained of the characteristic time reac- 
tion of the individual to decision situations of a given diffi- 
culty, to such situations as compared with situations of less 
and greater difficulty, the ccwistancy of such time reactions, 
and the correctness of the resulting decisions. 

Professor Muensterbergfs so-called judgment test* was 
chosen for a starting point. The test from which the present 
data were obtained is, however, much changed from the Muen- 
sterberg test. The object of the changes has been to make the 
test more adapted for bringing out the decision reactions men- 
tioned above. 

The capital letters ,E, I, Y, and K were selected after experi- 
mentation as having more uniform appeal to attention than 
the Muensterberg letters. A, E, O, and U, and unlike the 
Muensterberg test, no additional letters were used. These four 
letters are arranged in five rows of ten letters each on twenty- 
four cards three and a half inches long by two and three- 
fourths inches wide, the letters occupying a block at the top 
of the card. Only four arrangements of letters were used 
throughout the series of twenty-four cards, giving four situa- 
tions of graded difficulty as follows : grade I, the most easy of 

*Htigo Muensterberg, Psychology and Industrial Efficiency pp. 
83-96, and J. W. Bridges, Psychological Review Monographs, Aug. 
1914, pp. 51-55. 
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decision, in which, the predominating letter appeared twenty- 
six times, and the three non-predominating letters eight times 
each; g^de II; in which the predominating letter appeared 
twenty-three times, and the non-predominating letters nine 
times each; grade III with the predominating letter twenty 
times, and the non-predominating ten times each; and grade 
IV, the most difficult, in whidi the predominating letter 
appeared seventeen times and the non-predominating eleven 
times each. These four arrangements of letters were 3elected 
after experimentation, a general mixing of the letters being 
sought instead of " catchy " arrangements in which the pre- 
dominating letters were arranged on the edge of the field, etc., 
that the basis for difficulty might be niunerical so far as pos- 
sible. The aim in the selection pf total number of letters, 
number per line, pumber of lines and arrangement within the 
lines was to obtain four grades of difficulty which would, on 
the average, take for decision times from two seconds for the 
easiest grade to ten or fifteen seconds for the most difficult. 
The averages of the groups included in this study approxi- 
mate these figures. ' 

Four cards make up grade I and IV respectively, and eight 
cards grades II and III respectively, diflferent predominating 
letters, merely, being substituted in the four arrangements. 
While it was desired that all cards within a given grade should 
be identical with the exception of the different predominating 
letter, this is obviously impossible, since, for example, on a 
K card we might have a K between an I and an E, but on an 
E card we cannot have an E between and I and an E, but must 
substitute some other non-predominating letter for the second 
E. All that was possible was to have the predominating let- 
ters occupy the same spatial position on the cards, with definite 
spatial relations to non-predominating letters, though not 
always to the same non-predominating letters. 

Since there are eight cards in both grades II and III, it ia 
obvious that not only does the same arrangement appear eight 
times in each of these grades, but that in four cases in each, 
the identical card appears twice. Preliminary experimentation 
and experience with the test both give little ground for 
objection to this on the score of greater facility in decision 
on repeated arrangements, or repeated cards. Apparently a 
card of the same arrangement appears very different when a 
different predominating letter is substituted, and the appear- 
ance of any pven card is quickly forgotten after a new card 
has been presented. Sometimes even two cards exactly alike 
can be presented to a normal subject in sequence without his 
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noticing that they are identical. However, this extreme situa- 
tion never occurs in the present test. 

The manner of givuig the present test is also very diflferent 
from that of the oripnal Muensterberg test. The cards are 
given in a definite sequence to each subject so that, unlike the 
Muensterberg test in which the cards were shuffled before 
beginning, each subject takes exactly the same test. This 
manner of giving the cards likewise allows the timing of 
decisions on separate cards. The principle in devising the 
sequence in which the .cards should be pven was to have 
no very difficult cards at the beginning before the subject 
was accustomed to the test or to discourage him at the task 
before him, no very difficult cards at the very end when there 
might be some measure of fatigue, no identical cards in suc- 
cession, and no two difficult cards in succession. 

The directions given the subject before he undertook the 
test, unlike the Muensterberg test, emphasized accuracy and 
not speed. It was desired to reproduce, as nearly as possible, 
the condition of decisions of real life, of which quick decisions 
form merely one group. There is to be sure always some time 
element in actual decisions, and a suggestion of this was 
brought into the directions by telling the subject that while he 
was not limited as to time, his time was being recorded for 
every card. 

The decision and time of decision on each card was then 
recorded by the examiner. The time was recorded merely in 
seconds by an ordinary second hand. Exact laboratory 
methods were ^ot desired for a test that was planned for free 
use outside the laboratory in connection with routine scales. 
However, since separate cards are timed and time, decision on 
grade I was often one or two seconds, it is felt that the method 
is not fine enough, and that a stop watch should have been 
used to measure fractions of a second. However, though the 
rougher method was tised in obtaining the data presented here, 
the diflferences in the individual records and between the two 
groups are so striking as not to be attributable to the rough- 
ness of the method, and so seem to be of value in spite of it. 
Accuracy records are, of course, not aifected by this. The 
lack of introspective data from the subjects is also to be 
regretted. 

In evaluating the individual records, the following measures 
were used : total time taken for the test, average time spent on 
a card of each grade, porportional variation of the decision 

times of the individual on each grade v^* ^'^' accuracy on 
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each grade, and the six ratios between the average four grade 
times to show how much time the individual spent on harder 
decisions as compared with easier ones. The use of the 
measure of proportional variability involved much labor which 
seemed out of proportion to the results obtained from it. 
While some such measure was needed to show how constantly 
an individual spent a given amount of time on problems of 
the same degree of difficulty, only large variations seem to be 
very important since all of the nonnal individuals showed con- 
siderable variability, and such high variability can be fairly 
easily discovered on glancing through the record. The 
measures of total time, average grade times and grade accuracy 
are, of course, essential and easily obtainable. The use of the 
six ratios is less readily obtained and makes the test less easy 
to evaluate. In comparing a single record with the norm for 
the grroup, the six ratios can be fairly accurately estimated at 
a glance, the detailed figuring being necessary only in compar- 
ing groups. 

2. Comparison of Men and Women, 

The test was pven to 150 men and women, college students. 
They were, for the most part, undergraduates, with a few 
graduate students. They were not chosen for any special 
qualities or abilities, but constituted a general mixed group 
which volunteered for the test. The average age of the two 
groups was practically the same, that of the 75 men being 
2024 years, and that of the 75 women 20.99. The groups 
were also both fairly homogeneous in age, the mean variation 
from the average ages of the group being .99 of a year with 
the men, and 77 of a year with the women. 

Both groups were being tested at the same time, and by 
the same examiner. The examining was done before the 
make-up of the classes was changed by the war. 

Comparing the performances of the two groups for decision 
time, we find that on each grade each group took more time 
on the average than on the preceding g^ade. Each group, then, 
spent on the average more time for decision on harder situa- 
tions than on the easier ones. The average times for the two 
groups were as follows : 

Total Time Grade I Grade II Grade III Grade IV 

Men 2' 57" 2.76" 3.99" 6.l(y 9.10* 

Women 2' 8" 3.59" 5.05" 8.18" 14.34" 

It is also evident from these figures that the women took more 
time, on the average, on each grade than the men, with the 
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diflfcrence slightly more marked on the more difficult grades, 
the relation of women's time to men's time being as follows: 

Gradcl 1.30:1 

Gradell 1.26:1 

GradcIII 1.34:1 

Grade IV 1.54:1 

The limits of variation with both groups were wider on 
each succeeding grade, with the reaction times of both groups 
least homogeneous on grade IV. The women group showed 
wider limits of variation on each grade than the men group. 

C^nparing the two groups for accuracy, the women had 
fewer mistakes on all four grades than the men. 

On grade I, only one mistake occurred among the women, 
and seven among tiie men, an average of .013 and .09 respec- 
tively. The seven mistakes of the men were distributed among 
five individuals, three making one mistake apiece, and two men 
two each. 

On grade II the men made thirty-two mistakes and the 
women sixteen, an average of .43 and .21 respectively. The 
sixteen mistakes of the women were distributed among thirteen 
individuals, ten making one mistake apiece and three making 
two apiece. The thirty-two mistakes of the men were dis- 
tributed among fifteen individuals, six making one mistake 
apiece, three making two apiece, five making three apiece, and 
one making five. There were then approximately the same 
number pf individuals in each group making mistakes in the 
grade, but there were more individuals among the men making 
more than one mistake apiece. 

On grade III, the men had ninety-nine mistakes, and the 
women eighty-three, an average of 1.32 and 1.10 respectively. 
The eighty-three mistakes of the women were distributed 
among forty-two individuals, seventeen having one apiece, 
twelve two apiece, seven three apiece, four four apiece and 
one having five. The ninety-nine mistakes of the men were 
distributed among fifty-four individuals, twenty-five having 
one apiece, seventeen two apiece, eight three apiece, and four 
four apiece. On this gjade, then, there were more individuals 
making mistakes among the men than among the wcnnen, but 
not more men making a large number of mistakes. 

On grade IV, the men made one hundred and sixty-four 
mistakes, and the women one hundred and thirty-five, an aver- 
age of 2.18 and 1.77 respectively. The mistakes were dis- 
tributed through practically the entire groups (seventy-two 
men and seventy-one women) as follows : 
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Women 


Men 


1 mistake 

2 " 

3 " 

4 " (aU) 


26 

27 

17 

1 


17 

26 

21 

8 



More men than wonicn, then, made three or four mistakes and 
fewer only one or two mistakes. 

While the women, then, were more accurate than the men 
on all grades, this difference is more marked on the two easier 
grades. 

In order to compare the accuracy per individual for the 
whole test among the two groups, a kind of arbitrary point 
scaling was adopted. A mistake in grade IV was coimted one, 
in grade III two, in grade II three, and in grade I four, on the 
principle that mistakes in grade IV, the most difficult grade, 
were more to be expected tfian on grade I, etc. A low score> 
then, means good accuracy. 

RBCcmDS For Mistakes bt Point Scaling 
Fbints Men Women 






2 


5 


1 


6 


13 


2 


8 


10 


3 


10 


10 


4 


6 


7 


5 


10 


8 


6 


11 


2 


7 


3 


1 


8 


2 


4 


9 


2 


2 


10 


3 


6 


11 


1 


3 


12 


1 


2 


13 


2 





14 


2 






The average score for the women by this method of point 
scaling was 4.64 and that of the men 6.48. In addition to the 
scores on the table, there were among the women a score of 
fifteen and one of sixteen, and among the men one each of 
16, 17, 19, 24, 27, 29. Excluding these exceptional cases, we 
still have a lower average among the women, though the differ- 
ence is not so marked. The average score for the women 
would then be 4.34, and for the men 5.13. These results imply 
that there were a larger number of men than women who 
made exceptionally bad records for accuracy, but that even 
with the exception of such cases, the average accuracy among 
the women was higher than among the men. This will be 
considered later under grouping of individuals. 
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Comparing the two groups for perfect or very good accuracy 
records, we find two men and four women with perfect 
accuracy records, five men and twelve women whose only mis- 
take was a single one in the most difficult g^rade, six men and 
ten women whose only mistakes were in the most difficult 
grade, one man and no women whose only mistake was one in 
grade III and six men and five women whose only mistakes 
were in grades III and IV. There were then more very high 
accuracy records among the women. 

A comparison of the two groups for ratios of times spent 
on more difficult grades as compared with more easy ones 
shows that both groups spent more time on the average on a 
more difficult grade as compared with an easier one. All 
of the ratios, except the ratio 2/1 (that is, of grade II as com- 
pared with grade I) were larger with the women than with 
the men. The differences were not marked, however, except 
in the ratios involving grade IV for which the women showed 
nnuch larger ratios. 'Die six ratios for the two groups and 
<iXMTiparison of the two groups follow. The women, then, 

Jiatias 2/1 3/1 4/1 4/2 4/3 3/2 

Women 1.55 2.43 4.06 2.68 1.70 1.56 

Men 1.60 2.39 3.54 2.22 1.49 1.51 

Ratios 2/1 3/1 4/1 4/2 4/3 3/2 

Relation Women to Men. 1:1.03 1.01:11.14:1 1.20:1 1.14:1 1.03:1 

while taking more time than the men apportioned their time 
among the grades much as did the men with the exception of 
grade IV in which they took much more time as compared 
with the easier grades than did the men. Of the nine hundred 
individual ratio records (four hundred and fifty for the 
seventy-five men and four hundred and fifty for the seventy- 
five women) only sixty-seven or about 7% showed no grada- 
tion (no rise in time for a more difficult grade) or mverse 
gradation (less time on a more difficult grade). These sixty- 
seven instances are divided about equally among the two 
groups (thirty-five for the women and thirty-two for the men) 
and are distributed among the same numbers— one-third— of 
each group (twenty-five women and twenty-six men). Rela- 
tively few cases of inverse or lacking gradation occured be- 
tween grades which were not successive. The largest number 
of inverse or lacking gradation with the women (fourteen) 
occurred between the two easiest grades, ratio 2/1, and the 
largest number with the men on ratios 4/3 (thirteen) and 
3/2 (eleven). 

Comparison of the two groups for variability of decision 
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times within the grades shows for both groups lower variabil- 
ity on more difficult decisions with the exception of grade I. 
Since timing was only in seconds and the average time on 
grade I for men and women was respectively 2.76 " and 3.59 ", 
the proportional variation in seconds on grade I is obviously 
not reliable. The women showed less variability in their 
decision times on all grades except the most difficult on which 
they were more variable than the men, as follows : 

Proportional Variability Grade I Grade II Grade III Grade IV 

Men 370 .480 .395 .280 

Women 335 .436 .364 .307 

To the end of finding correlations in the two groups of the 
numerous factors mentioned above, an attempt was made to 
separate the larger groups into smaller groups or decision 
types. Certain groups stand out at once as homogeneous. 

Most conspicuous among the men is a very quidc, ungraded 
(i.e. with low ratios or inverse ratios) inaccurate group. 
This group is also found among the women, but is not so 
numerous. ; It comprises 20% of the men and 12% of the 
women. While both of these groups are inaccurate, that of 
the men was more inaccurate than that of the women. A 
large percentage of the mistakes of the total group of men 
is due to this very quick group, all of the mistakes (seven) 
on grade I coming within this group. The average mistakes 
of this group as compared with total group of men were as 
follows : 

Grade I Grade II Grade III Grade FV 

Quickgroup 46 1.53 2.26 2.46 

Total group 09 .42 1.32 2.18 

They made 71% of the mistakes made by men on Grade 
II, whereas their ntunber entitles them only to 20%, 34% of 
the mistakes on grade III and 22% of the mistakes on grade 
IV. The fact that this group approximates the average more 
closely on grade IV would seem to imply that even for fairly 
careful deliberation grade IV is difficult and that the differ- 
ence between hasty and prolonged deliberation becomes less 
marked in results on this grade. 

The quick women made the only mistake on grade I made 
by the women group, had 62% of the mistakes of the women 
group on grade II, 25% of the mistakes on grade III and 18% 
of the mistakes on grade IV, whereas their number entitles 
them to only 12% on each. The inaccuracy of the quick 
women, then, represents more of a divergence from the 
accuracy standard of the women group than does that of the 
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men, though the absolute inaccuracy of the quick men was 
greater than that of women. These quick, inaccurate wcHnen 
averaged less quick in their decisicm times than the quick inac- 
curate men. 

A very few of the men, (two, and possibly a third) making 
quick relatively ungraded decisions were able to miake high 
accuracy records. This condition was not found among the 
women. 

A second type of reaction was indicated in both sex groups, 
a slow accurate type. This was much more numerous am<mg 
the women, comprising 24% of the women and only 14% of the 
men. The women of the group likewise averaged slower than 
the men and showed more extreme examples of slow decisions 
than the men. These slow groups are less homogeneous than 
the quick groups, but agree in being more accurate than the 
rest of the 5ex groups, though the women are more accurate 
than the men. They also average higher ratios. They divide 
into three general groups, the first characterized by high 
gradation of the ratios involving grade IV (that is, composed 
of those who took an excessive amount of the time on grade 
IV alone), the second characterized by high proportional varia- 
tions (composed of people whose excessive time was due to 
occasional very large decision times on individual cards and 
not on whole grades), and the third composed of those who 
took a constantly excessive amount of time on all grades and 
on all cards within the grades. The first group was found 
only among the women (seven of the eighteen cases) and 
was an exceedingly accurate group (only one mistake on g^de 
IV was made by the whole group). The condition of occa- 
sional very large decision times is not confined to this slow 
group and will be considered separately. One of the slow 
men and two of the slow women owed their excessive time 
to very slow decisions on the easiest grade alone. This exces- 
sively cautious group was accurate like the rest of the slow 
cases. 

Since the quick inaccurate reaction is more numerous among 
the men and the slow accurate among the women, the remainder 
of the two sex groups (comprising approximately two thirds) 
were compared to see if the differences in the averages of 
the two sex groups are due to the existence of the two groups 
discussed above, quick inaccurate and slow accurate. This is 
found not to be the case. The remaining women are still 
slower and more accurate (except for grade III on which the 
two groups have practically the same accuracy) than the 
remaining men, though the groups approximate one another 
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much more closely than do the general sex groups, as follows : 

MitUkM 
Total Grade Grade Grade Grade Per Indi- Grade Grade Grade Grade 
Time I II III TV vidual I II III TV 

2x3 Men 124' 2.52 3.85 5.9B 8.94 .18 1.14 2.12 

2x3 Women... 151' 3.06 4.13 6.70 11.80 .10 1.16 1.61 

Within this two-thirds group greater time still tends to be 
correlated with greater accuracy with both sexes, but for any 
given time women tend to be more accurate than men taking 
the same time. 

The cases showing high proportional variability were prin- 
cipally of two kinds : the first consisted of cases who were fairly 
quick and irregular in their times, and the second those whose 
variability was due to occasional very delayed or blocked 
decisions. The quick irregular group (that is, those whose 
times averaged a given time which none of the times clustered 
closely around) was larger among the men and the blocked 
group much larger among the women. The fairly quick irregu- 
lar group tended to be less accurate than both the whole group 
and the two-thirds group left after eliminating the quick inac- 
curate and slow accurate. Blocking seemed to be a fairly 
constant tendency among the women and blocked times shade 
into non-blocked times, while with the men the blocking 
tendency seems less characteristic and blocked decisions are 
more sharply differentiated in time from non-blocked decisions. 
Among both sex groups, cases characterized by blodcing aver- 
aged more accurate than the whole group or the two-thirds 
group, though the most delayed separate decisions occurring 
in both sex groups were more inaccurate than the other 
decisions. The blocked decisions of the men showed a higher 
percentage of inaccuracies than those of the women. More 
extreme cases of blocking occurred among the women. 

The constant decision time cases (those with low propor- 
tional variability) divide into two definite groups, a small 
accurate group, and an inaccurate group characterized by low 
ratios. The latter is considered an undeliberative group in 
which there was also no particular tendency towards impul- 
sive action. 

Considering decision times on separate cards apart from the 
individual cases to see if quicker times than the average of 
the individual or slower times were more likely to lead to 
inaccurate results, it was found that with both sexes more 
wrong decisions were correlated with decisions taking more 
than the average time of the individual for the grade than with 
decisions taking less, with the exception of grade IV on which 
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slightly more of the ^nistakes were correlated with decisions 
taking less than the average. Both sexes had more mistakes 
correlated with average time decisions on grade IV than on 
any other grade, implying .again the difficulty of grade IV. 
The most delayed decisions as compared with the average time 
of the individual had more than their quota of mistakes, as 
mentioned above, and the quickest fewer than their quota. 

The women took a larger amount of time on the first few 
cards as compared with tfieir average time than did the men. 
Though they thus adapted themselves less quickly to the new 
situation which the test implies, they adapted themselves more 
accurately, since they show fewer mistakes for the first few 
cards. 

Considering the most accurate cases among the men and 
women, they are found to have slow time, high ratios and 
high porportional variations. The majority of the very inac- 
curate cases with both men and women belong to the very 
quick ungraded group, and the remainder show similar, if not 
such extreme, conditions— quick times and low ratios. 

Of the cases showing lower gradation than the average on 
all ratios, a large majority with both sexes belong either to 
the very quick ungraded inaccurate group or to the slow, low 
variability, inaccurate group. Of the few cases remaining, 
two-thirds showed average accuracy and the other third poor 
accuracy. 

Cases showing higher gradation than the average on all 
ratios were uniformly slow and accurate with both sexes. 

The results then show fairly well marked decision groups, 
varying in their representation in the two sex groups, and 
some well marked decision tendencies and correlations of 
decision tendencies. The most marked groups are the very 
quick ungraded inaccurate g^up, most numerous among the 
men, and the slow graded accurate group, most numerous 
among the women, and the ungraded' inaccurate group. 
Among the decision tendencies, most marked is the tendency 
toward frequent very delayed decision times among the 
women. This is an exaggeration of the general tendency 
toward slow decision times characteristic of most of the 
women group, contrasted with the tendency to very quick 
decisions among the men. The greater accuracy record of the 
women group throughout is striking. Among the correlations 
irrespective of the groups though compatible with the condi- 
tions found in them, are higher accuracy with slower times 
and higher ratios, and lower accuracy with quicker times and 
lower ratios. 
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BOOK REVIEW 

Henry C. Link. Employment Psychology, The Macmillan G>., New 
York, 1920, p. xii +440. 

A novel which attempts to tell a tale and preach a moral at the same 
time rarely succeeds in doing either particularly well. Any book taking 
major premises and attempting to draw minor premises, which shaU 
result in true conclusions, labors under a dual handicap; its major 
premises are apt to be misstated, or its minor premises are liable to be 
only logical and not to work in practice. Just so, he who attempts to 
apply a science to the practice of human affairs has in advance our 
sympathy or our criticism (depending upon our temperaments and 
dispositions). If either the science or its applications are relatively 
new, these suspicions and sympathies are aggravated. 

The applications of theoretical psychology to industrial practices are 
recent and its literature is correspondingly meager of quantity and on 
the whole bare of quality. Employment Psychology is. Mr. Link's 
second book in this ambitious field. The book is divided into four 
parts: Part 1, Psychological Tests; Part 2, Trade Tests and other 
applications of employment psychology; Part 3, Selection and Reten- 
tion, and Part 4, Conclusions. 

Part 1 — Psychological Tests— attempts to show the results of actual 
tests given to different types of workers, both in the office and in the 
shop, indicating the modifications that have been made to ^ese tests 
to adapt them to differing circumstances. Difficulties are frankly con- 
sidered and solutions of these difficulties indicated, so far as they have 
been discovered. The psychological background is fairly and on the 
whole clearly stated, and the results are tabulated with scientific im- 
partiality. For the most part, the treatment is that of the psychological 
monograph but the usual heaviness of this procedure is enlivened by 
concrete circumstances and, for instance, by the treatment of general 
intelligence in a Platonic dialogue (Chapter 12), whose conclusions are 
that " There is no such thing as general intelligence, and that, if there 
were, it would be of little use to us in employment work because we 
are interested in specific abilities or kinds of intelligence, and not in 
degrees of intelligence, per sef The writer of the book believes that 
the application of psychological tests, in certain cases, makes it possible 
to discover facts otherwise discoverable only by the costly method of 
trial and error, but he does not offer them as a general panacea. In 
his own phrasing: "The scope of psychological tests has been dis- 
cussed largely from the standpoint of their limitations." To be suc- 
cessful he believes that a test must be — a) carefully selected, b) based 
upon preliminary experiments upon a large group of workers simi- 
larly engaged, c) they must be checked by other and objective 
standards. 

Under Part 2, the author's discussion of Job Analjrsis and the Vesti- 
bule School is dear, practical and to the point, and is in line with the 
best constructive thinking of the day. Part 3 is more general and 
theoretical although its brief chapters offer thoughtful reading to the 
employment manager. 
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The same comment also holds for the latter chapters of the book 
under the heading ** G>nclusions " in Part 4. Probably more theoretical 
but nevertheless important general principles of employment psychology 
are here discussed, such as the applicant's point of view, Employment 
Psvchology, and the like. There is a considerable appendix and an 
index, the former outlining the tests upon which experiments described 
in the book are based 

Taken as a whole, this is a good book, and one particularly stimu- 
lating to the student of its problems. When one realizes the un- 
standardized and uncharted field that it attempts to cover, one inclines 
to superlative commendation. Certainly it is neither a text-book nor 
a book for leisure hours but what it purports to be, it is. Its introducer. 
Dr. Thomdike, says of it " an honest, impartial account of the use of 
psychological tests under working conditions in a representative in- 
dustry." This it is. 

In the present temper of the industrial mind, such a book will prob- 
ably not be thoughtfully read by most of those who should read it — 
notably the employers of labor. By and large the employer has not 
yet come to place so high a value upon those who assemble his per- 
sonnel as he does upon those who assemble his machines. Most em- 
ployment managers are still clerks. It is also unfortunate, but true, 
that in times of labor scarcity, employers give anxious thou^^t to these 
matters, while under conditions of labor surplus, selection is deemed 
to be easy and elaborate psychological tests only tmnecessary frill and 
refinement suott nosT. 
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